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Preface 

4 

This  report  is  a  summary  of  research  accomplished  ca  operational  train* 
ing  by  aviation  psychologists  in  the  Continental  Air  Faces  during  tha 
latter  part  of  World  War  II. 

In  the  presentation  of  this  report  there  are  two  related  objectives.  First, 
an  attempt  will  be  made  to  present  a  record  of  the  research  activities  of 
aviation  psychologists  in  the  Continental  Air  Forces;  second,  it  is  hoped 
to  provide  a  summary  of  psychological  research  on  operational  training 
that  will  be  of  value  to  future  research  workers  in  this  field.  Additional 
and  basic  information  relative  to  this  report  may  be  found  fa  the  most 
part  in  the  files  of  the  Psychological  Branch,  Office  of  the  Surgeon,  Head¬ 
quarters,  Strategic  Air  Command,  Andrews  Field,  Camp  Springs,  Maryland. 

Credit  for  the  data  included  in  this  report  is  due  primarily  to  the  di¬ 
rectors  and  staffs  of  the  separate  research  projects  in  each  of  the  con* 
tinental  air  forces.  These  projects  were  established  and  functioned  directly 
under  Headquarters,  Army  Air  Forces  for  several  months  prior  to  the 
activation  of  Headquarters,  Continental  Air  Forces.  The  data  presented  are 
essentially  consolidations  of  data  provided  by  research  personnel  of  each 
of  several  air  forces.  In  the  report  no  attempt  has  been  made  to  assign 
special  credit  to  individuals  since,  for  the  most  part,  all  participated  as  a 
t«tm  in  the  activities  carried  on.  A  complete  roster  of’ all  psychological 
research  personnel  involved  appears  in  Chapter  1,  table  1.1  of  this  report. 

The  planning  and  execution  of  the  final  report  has  also  been  a  coopera* 
tive  effort  The  outline  and  framework  of  the  report  were  developed  at  a 
conference  of  representatives  of  research  personnel  of  all  four  air  forces 
and  of  Headquarters,  Continental  Air  Forces.  The  original  writing  of  most 
of  the  chapters  was  delegated  to  the  staffs  of  the  various  air  forces.  Final 
revision  and  editing  was  accomplished  by  the  research  personnel  of  the 
Psychological  Branch,  Office  of  the  Surgeon,  Headquarters,  Continental  Air 
Forces.  Appreciation  is  also  due  personnel  of  the  Psychological  Branch, 
Office  of  the  Air  Surgeon,  Headquarters,  Army  Air  Forces,  who  read  all  of 
the  chapters  of  this  report  and  made  many  helpful  suggestions  and  criti¬ 
cisms. 

LEWIS  B.  WARD, 

Lt  Co!.,  A.C. 


Bolling  Field,  D..C.,  1  June  1946 
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CHAPTER  ONE _ •  ■ 

Introduction 


This  summary  of  psychological  research  in  the  Continental  Air  Forces 
was  prepared  as  one  of  a  series  of  veports  on  the  activities  and  findings  of 
the  Aviation  Psychology  Program  in  the  Army  Air  Forces.  While  the  ms» 
terial  presented  herein  was  gathered  entirely  within  the  Continental  Air 
Forces,  its  significance  may  best  be  appreciated  in  relation  to  the  research 
of  aviation  psychologists  in  other  commands,  which  is  treated  in  detail  in 
other  reports  in  this  series.  Since  psychologists  were  assigned  to  the  Con¬ 
tinental  Air  Forces  relatively  late  in  the  war,  their  mission  was  largely 
determined  by  the  work  already  done  in  the  Aviation  Psychology  Program 
during  the  prevkwu  3  yean. 

In  this  introductory  chapter  there  is  first  presented,  for  readers  unfamiliar 
with  operational  training,  a  brief  statement  of  the  history,  organisation, 
and  training  function  of  the  Continental  Air  Forces.  This  is  followed  by  a 
statement  of  mission,  organization,  personnel  and  operating  procedures  of 
the  psychologists  within  the  command.  Finally,  there  is  a  discussion  of. 
certain  characteristics  of  training  in  the  Continental  Air  Forces  which  of¬ 
fered  special  difficulties  to  aviation  psychologists  in  the  fulfillment  of  their 

nwgAni- 

y  .  r  ■ ' 

THE  CONTINENTAL  AIR  FORCES 

s  ,  ■ 

History  and  Organization 

The  origin  of  the  Continental  Air  Forces  may  be  traced  to  the  reorgani* 
zation,  in  1935,  of  the  Army  units  charged  with  training  of  aviation  person¬ 
nel  and  employment  of  aircraft  In  the  reallocation  of  missions,  the  General* 
Headquarters,  Air  Forces  was  established  with  the  responsibility  for  training 
combat  organizations  in  aerial  warfare.  The  training  of  individuals  in 
various  specialties,  both  aerial  and  ground,  remained  under  the  direction 
of  the  Office,  Chief  of  the  Air  Corps.  Later,  the  AAF  Training  Command 
was  established  and  took  over  the  mission  of  individual  training.  The 
First,  Second,  Third  and  Fourth  Air  Forces,  which  make  up  the  bulk  of' 
the  present  Continental  Air  Forces,  grew  out  of  the  commands  under  Gen¬ 
eral  Headquarters,  ."Jr  Forces.  These  four  air  forces  were  activated  in 
March  1941,  with  the  primary  mission  of  defense  of  the  continental  United 
States.  With  the  declaration  of  war  on  8  December  1941,  the  First  and 
Fourth  -Air  Forces  became  almost  exclusively  engaged  in  the  defense  of* 
the  eastern  and  western  parts  of  the  United  States  respectively,  while  the 
Second  and  Third  were  assigned  the  training  of  combat  units.  As  the  need 
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for  air  defense  of  the  continent  became  lest  important,  aC  four  air  forces 
became  in  training. 

During  the  last  2  yean  of  the  war,  the  four  Continental  Air  Forces 
occupied  approximately  the  following  sections  of  the  country.  The  First 
Air  Force  extended  along  the  eastern  seaboard  .from  Massachusetts  to 
Georgia  with  headquarters  at  Mitchel  Field,  Hempstead,  Long  Island.  The 
Second  Air  Force,  with  headquarters  at  Colorado  Springs,  Colorado,  cov¬ 
ered  the  PL:;**  and  Rocky.  Mountain  states  together  with  western  Texas, 
New  Mexico  and  Arizona.  The  Third  Air  Force  extended  throughout  the 
Southeast  and  was  administered  from  Tampa,  Fla.  The  Fourth  Air  Force 
had  bases  along  the  west  coast  with  headquarters  at  San  Francisco,  Cali¬ 
fornia.  Each  of  these  air  forces  had  certain  subordinate  wings  which 
specialized  in  training  on  different  types  of  aircraft.  During  the  last  half 
oi  1944  and  the  first  half  of  1945.  training  on  different  types  of  airplanes 
was  distributed  as  follows.  The  First  Air  Force  was  responsible  for  medium 
(B-25  and  B-26)  and  heavy  (B-24)  bombardment  training,  and  for 
fighter  training  tiring  P-47  and  P-47N  (very,  long  range)  airplanes.  The 
Second  Air  Force  carried  on  P-40  and  P-47  fighter  training,  heavy  bom¬ 
bardment  training  using  both  B-17's  and  B-24’s,  and  very  heavy  bombard¬ 
ment  training  employing  B-29’s.  The  Third  Air  Force  included  wings 
responsible  for  fighter  training  using  P-5l’s,  heavy  bombardment  training  | 
using  B-17’s  and  during  1945,  very  heavy  bombardment  training  with  | 
B-29’s.  The  Fourth  Air  Force  gave  training  in  P-38  fighter  aircraft,  P-61  j 
night-fighter  aircraft,  and  heavy  bombardment  using  B-24'a.  j 

By  the  end  of  1944  all  four  air  forces  and  the  First  Troop  Carrier  Com-  j 
maud  were  primarily  engaged  in  training  for  overseas  duty.  This  similarity 
of  functions  resulted  in  the  establishment  of  a  single  administrative  and 
operating  headquarters  for  the  five  commands.  On  15  December  1944, 
Headquarter*,  Continental  Air  Forces  was  activated,  to  be  opened  on  1 
April  1945  in  its  temporary  headquarters  at  Bolling  Field,  D.  C.  The  mis¬ 
sion  of  this  headquarters  was  to  operate  three  general  types  of  activities: 
training  for  overseas  duty  of  new  personnel  received  from  the  AAF  Train¬ 
ing  Command,  redeployment  of  personnel  and  units  from  Europe  to  the 
Pacific,  and  air  defense  of  the  continental  United  States.  Policy  making  for  j 
the  commands  under  this  headquarters  remained  at  Headquarters,  Army  j 
Air  Forces.  -  I 

General  Training  Procedures  -  J 

Operational  training  in  the  Continental  Air  Forces  typically  began  with  , 
the  receipt  of  individuals,  trained  is  their  aerial  or  ground  specialties,  from 
schools  within  the  AAF  Training  Command.  In  operational  training,  these 
individuals  were  fitted  into  combat  organizations,  taught  to  use  combat- 
type  equipment  and  instructed  in  the  basic  tactics  of  aerial  warfare.  Upon 
completion  of  this  training,  they  were  shipped  to  the  combat  zone  where 
they  either  began  combat  operations  immediately  or  received  further  train- 


log  in  the  particular  tactical  doctrines  employed  in  the  theater  to  which 
they  were  assigned.  In  general,  training  in  the  Continental  Air  Forces  was 
designed  to  simalate  as  closely  as  possible  the  conditions  of  aerial  warfare. 

The  basic  requirements  to  be  completed  in  operational  training  were 
stated  in  publications  called  Training  Standards,  originally  prepared  at 
Headquarters,  Army  Air  Forces.  After  its  establishment,  Continental  Air 
Forces  carried  on  this  function.  The  Training  Standards  set*  forth  the 
minimum  requirements  to  be  accomplished  in  each  type  of  operational 
training.  These  were  usually  stated  in  terms  of  number  of  hours  to  be  qent 
in  flying  and  ground  training,  and  listed  the  subjects,  types  of  maneuvers 
and  aerial  exercises  to  be  covered.  The  headquarters  of  the  four  air  forces 
amplified  these  training  standards  in  appropriate  training  manuals  which 
constituted  syllabi  for  the  courses  included  in  the  various  types  of  training. 
The  training  requirements  and  procedures  Tver;  further  amplified  by  sub¬ 
ordinate  training  wings,  and  particular  schedules  for  each  class  were  draws 
up  at  the  station  level.  In  general,  training  schedules  prepared  at  lower 
echelons  included  somewhat  more  work  than  the  minimum  specified  In 
training  standards  from  Headquarters,  Army  Air  Forces.  This  extra  work 
was  completed  as  time,  weather  and  maintenance  conditions  permitted. 

Operational  training  was  accomplished  according  to  two  general  plans. 
The  older  plan,  referred  to  as  OTU  (Operational  Training  Unit)  training, 
was  used  to  get  an  entire  aerial  combat  organization  ready  for  overseas 
shipment  This  included  the  training  of  both  air  and  ground  echelons  at  all 
levels  of  command  from  the  bomber  command  to  the  squadron.  On  an  OTU 
base,  trainee  personnel  included  the  complete  complement  of  a  group  made 
up  of  three  squadrons.  The  ground  and  flying  training  of  this  personnel  was 
the  responsibility  of  the  Director  of  Training,  a  member  of  the  permanent 
party  of  the  base,  assisted  by  permanent  party  instructors.  Flight  and 
squadron  commanders  and  other  supervisory  personnel  of  the  group  assisted 
in  this  training,  gradually  taking  over  the  responsibility  toward  the  end  of 
the  period.  Approximately  four  months  were  required-  to  accomplish  mini¬ 
mum  training.  While  subordinate  groups  were  being  trained  at  various  sta¬ 
tions,  their  higher  echelon  command  organization,  wing  and  bomber  or 
fighter  command,  was  based  at  a  central  location,  and  was  engaged  in  per¬ 
fecting  its  organization  and  working  out  tactical  exercises. 

After  overseas  air  forces  were  in  operation,  training  was  largely  done  in 
CCTS  (Combat  Crew  Training  Station)  in  order  to  provide  replacement 
crews  to  keep  the  overseas  organizations  up  to  strength.  The  same  training 
directives  were  used  as  in  OTU  training,  but  trainee  personnel  comprised 
only  combat  crews.  The  Director  of  Training  and  instructors  wert  perma¬ 
nent  party  personnel  and  typically  remained  at  the  statical  though  succes¬ 
sive  classes.  Normally,  at  any  given  time  there  were  present  on  a  base 
either  two  or  three  classes  in  different  stages  Ji  training.  The  CCTS  train¬ 
ing  program  was  more  typical,  in  terms  of  organization  plan,  of  that  in  the 
AAF  Training  Command  than  was  OTU  Training,  since  successive  classes 
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were  seat  through  a  stagmg  nt  to  tbe  oveaeas  units  needfeg  rcpbccmeats. 

Toward  tbe  dose  o t  tbe  war  ia  Europe,  a  third  type  of  trainiaf  was 
■datahn  by  tbe  air  forces  ia  coonectiow  with  tbe  rakploywKwt  pragma. 
Combat  orgari  rations  were  returned  intact  from  tbe  European  theater,  re- 
plactmentt  were  added  if  seeded,  and  tbe  complete  orp  motion  was  re¬ 
trained  for  duty  in  tbe  Pacific.  Tbe  genera]  plan  of  this  training  followed 
that  of  tbe  0117  training  described  above.  By  tbe  time  redeployment  got 
under  way,  psychological  research  sections  were  occupied  with  other  studies, 
so  that  no  personnel  were  available  to  obtain  data  ia  this  program. 

ASSIGNMENT  OF  RESEARCH  PERSONNEL 


General  Missim 

Aviation  psychologists  were  asrignrd  to  the  Continental  Air  Forces  for 
the  primary  purposes  of  making  foOow-cp  studies  of  aircrew  members 
undergoing  operational  training.  At  this  time,  the  psychological  program 
bad  already  been  in  operation  for  2%  years  in  the  AAF  Training  Command, 
where  a  battery  of  psychological  tests  was  administered  to  all  aircrew  can¬ 
didates  for  selection  and  far  dassificatkwi  in  aircrew  specialties.  The  results 
of  these  tests  bad  been  extensively  validated  against  success  or  elimination 
hum  Training  Command  Schools.  To  follow  these  individuals  through  op¬ 
erational  training  represented  the  next  logical  step  in  validating  the  selec¬ 
tion  and  classification  procedures.  Because  Continental  Air  Forces  training 
simulated  combat  conditions,  and  at  tbe  same  time  offered  data  which  were 
more  accessible  than  any  which  could  be  obtained  in  the  theaters,  follow-up 
studies  in  the  training  air  forces  were  regarded  as  essential  Further,  it  was 
believed  that  psychologists  could  furnish  useful  information  on  aircrew  per¬ 
sonnel  by  making  available  psychological  records  from  the  AAF  Training 
Command  and  by  devising  and  administering  new  tests  for  special  types  of 
assignments.  On  23  August  1944  a  letter  was  addressed  to  the  Commend¬ 
ing  Generals  of  the  First,  Second,  Third  and  Fourth  Air  Forces,  subject 
“Research  Officers,”  which  assigned  psychological  personnel  to  these  com¬ 
mands  ar  1  included  the  following  general  statement  of  mission: 

a.  To  collect,  assemble,  mod  make  available  to  commanding  officers,  classification  test 
•cores,  stanines,  proficiency  test  scores,  training  records  and.  combat  adjustment  test 
scores,  and  to  advise  concerning  tbe  use  of  such  information  in  tbe  selection  of  person¬ 
nel  for  lead  crew  and  other  special  types  of  operational  training. 

b.  To  administer  aptitude  and/or  proficiency  tests  when  indicated  for  the  purpose  of 
securing  additional  information  for  tbe  selection  of  personnel  for  special  training 

c.  To  collect  and/or  develop  criterion  data  on  tbe  proficiency  of  individuals  in  carry¬ 
ing  out  various  operational  duties.  Suds  data  will  be  used  in  refining  present  taring 
and  selection  procedures  or  will  be  forwarded  to  Headquarters,  AAF  Training  Com¬ 
mand  for  use  in  validation  studies  to  be  conducted  by  that  Headquarters. 


d.  T#  develop  new  Ms  or  teat  ^edhaOem  dnignul  <•  bomh  iptodo  sal 
psofiricncfcs  that  are  Important  foe  totem  la  cotabat  sad  that  art  oat  wmmmi  W 

«.  To  ondfttaia  atadks  of  attlhwW,  motivation  and  kadenUp  aMKy  at  In-  . 
dfcttad  by  local  problem  or  at  dbnctod  by  Headquarters,  Army  Air  Facets. 

Of  the  types  of  activity  directed  in  these  letters,  item  “c*  above,  on  the 
procurement  of  proficiency  measures  and  validation  of  test  results  called  lor 
the  major  effort  on  the  part  of  research  personnel. 

After  almost  a  year  of  research  experience  had  been  gained  In  the 
Continental  Air  Forces,  a  formal  statement  of  the  mission  of  aviation 
psychologists  was  published  in  AAF  Letter  No.  20-103,  subject  “Aviation 
Psychology  in  the  Continental  Air  Forces,”  dated  19  July  1945,  which  tomj 
be  found  in  the  Appendix  AJ.  Those  paragraphs  relating  to  misdan  are 
essentially  similar  to  the  ones  in  the  letters  of  23  August  1944,  but  no  refer¬ 
ence  was  made  to  the  development  of  new  tests  or  studies  of  attitudes, 
motivation  and  leadership.  These  deletions  resulted  from  a  derision  to  con¬ 
centrate  on  the  other  areas  of  research  mentioned  in  the  earlier  letter. 

Specific  Mission  of  Psychological  Sections  m  each  Air  Fore t 

Some  division  of  responsibility  in  the  accomplishment  of  the  over-aff 
mission  stated  above  was  made  among  the  psychological  sections  in  the  fodr 
airforces.  Shortly  after  psychologists  were  assigned,  letters  with  the  subject 
“Research  Project”  were  sent  from  the  Office  of  the  Air  Surgeon  to  each  air 
force,  indicating  particular  lines  of  investigation  to  be  followed  within  the 
framework  of  the  general  mission.  In  a  letter  dated  22  September  1944,  die 
First  Air  Force  unit  was  directed  to  make  a  follow-up  study  of  fighter  pilots 
in  order  to  provide  information  on  the  relative  validities  of  all  classification 
tests  for  predicting  fighter  pilot  success.  This  information  was  of  apodal 
importance  since  at  that  time  differential  stanines  were  being  assigned  for 
fighter  and  bomber  pilot  training  and  an  empirical  check  was  desired  on  the 
relative  weights  to  be  given  tests  for  the  fighter  pilot  stanine.  Suggestions 
as  to  the  type  of  criteria  to  be  used  were  made  in  this  letter,  one  paragraph 
of  which  is  quoted  below: 

2.  It  b  desired  that  medal  attention  be  given  to  a  follow-up  study  ot  fighter  pilots 
assigned  to  the  First  Air  Force  from  recent  AAF  Training  Command  Onset.  TUs 
follow-up  study  should  indude  collection  of  the  records  of  pilots  who  have  bad  acci¬ 
dents,  who  have  been  brought  before  Flying  Evaluation  Boards,  or  who  have  beta 
considered  unsatisfactory  because  of  lark  of  proficiency  or  other  reasons.  Records  ef 
percent  hits  in  fixed  gunnery  practice  and  records  of  gun  camera  missions  should  be 
collected.  An  effort  should  also  be  made  to  identify  individuals  who  have  been  out¬ 
standingly  successful  in  R.T.C,  training. 

With  this  assignment,  research  personnel  in  the  First  Air  Force  Imme¬ 
diately  concentrated  their  entire  attention  on  fighter  pilots  In  the  Ffnt 
Fighter  Command  of  that  air  force,  in  which  work  they  continued  until 
the  dose  of  the  war.  The  magnitude  of  these  studies  allowed  no  opportu- 
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ahy  for  studies  with  the  medium  cad  heavy  bombardment  crews  also  being 
trained  in  the  First  Air  Force. 

Letter,  Headquarters  AAF,  15  September  1944,  subject  "Research  Proj¬ 
ect,”  directed  that  studies  be  made  in  the  Second  Air  Force  on  problems 
in  the  formation  of  lead  crews.  This  letter  was  written  in  anticipation  of  a 
subsequent  interest  throughout  the  Continental  Air  Forces  in  the  selection 
and  training  of  lead  crews  before  their  shipment  to  combat  A  relevant 
paragraph  from  this  letter  follows: 

2.  At  tba  pretest  time  the  problem  of  selecting  tad  putting  together  individual*  for 
training  as  potential  lead  crews  is  considered  to  be  of  highest  priority  for  the  research 
ottem  is  your  Command.  The  Commanding  Geaerals  of  various  overseas  air  forces 
have  indicated  that  insofar  as  possible,  superior  individuals  should  he  identified  and 
trained  together  in  the  Zone  of  the  Interior  so  that  overseas  commanders  can  select 
lead  crews  .nsofar  et  practicable  from  among  these  potential  lead  crows.  The  develop¬ 
ment  of  specific  procedures  for  identifying  superior  individuals  has  already  received  a 
great  deal  of  attention.  Available  data  indicate  that  both  the  stanlne  scores  and  special 
combat  aptitude  ratings  computed  from  specific  classification  test  scores  give  significant 
predictions  of  combat  performance  and  should  be  interpreted  and  used  for  the  purpose 
outlined  above.  It  is  desired  that  (pedal  attention  be  given  to  further  work  on  the 
development  of  lead  crew  aptitude  ratings. 

While  they  were  still  in  the  Training  Command,  the  research  personnel 
who  were  assigned  to  the  Third  Air  Force  had  been  working  on  a  study  of 
the  attitudes  toward  a  second  tour  of  combat  duty  of  gunners  returned  from 
overseas.  Paragraph  2  of  a  letter  from  Headquarters  AAF,  dated  4  October 
1944,  directed  research  personnel  in  this  Air  Force  to  continue  «miy 
studies  on  the  utilization  of  returned  pilots,  bombardiers  and  navigators. 
Certain  statements  were  made  concerning  other  studies  which  should  be 
undertaken  by  that  research  section  as  indicated  by  the  succeeding  para¬ 
graphs  of  the  cited  letter:  ( 

3.  In  connection  with  the  type  of  study  outlined  in  the  preceding  pargaraph,  im¬ 
portance  is  attached  to  the  implications  of  this  or  similar  research  for  the  more  gen¬ 
eral  problems  of  lead .  .-ship,  motivation  and  attitude  in  AAF  personnel. 

4.  Research  that  V  concerned  with  the  problem  of  selecting  personnel  for  lead  crew 
and  other  sped  i!  t?  >*s  of  operational  training  is  important  as  well  as  follow-up 

to  determine  the  /alidity  of  present  selection  and  classification  tests  for  predicting 
proficiency  in  v* :  ous  operational  duties.  However,  sine*  considerable  research  on  this 
problem  is  unde  way  in  the  Second  Air  Force  and  in  various  overseas  Air  Forces,  it  is 
believed  deriral  't  at  the  present  time  for  personnel  in  your  command  to  give 
priority  to  rev  arch  on  the  problems  outlined  in  the  preceding  paragraphs. 

The  r.’ts.  of  concentration  for  the  psychological  section  in  the  Fourth 
Air  Fore.*  was  similar  to  that  for  the  First,  in  which  particular  emphasis 
was  giva  tc  studies  on  fighter  pilots,  especially  those  types  of  aircraft 
which  v  ere  used  only  in  the  Fourth  Air  Force.  Below  is  quoted  a  paragraph 
from  »  letter,  Headquarters .  AAF,  6  October  1944,  subject:  "Research 
Prof 'A.* 

2.  ft  is  desired  that  special  attention  be  given  to  a  follow-up  study  of  pilots 
tc  Jt  Fourth  Air  Force  from  recent  AAF  Training  Command  classes.  In  this  foljow- 
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up  study  special  consideration  should  be  gir*a  to  night-fighter  pilots  and  two  ughM 
fighter  pilots.  Studies  should  be  made  for  the  purpose  of  determining  the  type  «f 
individual  who  is  most  successful  as  a  night-fighter  and  a  two-engine  pSot  and  for 
determining  the  special  requirements  that  are  specific  10  operation  of  these  type*  of 

This  letter  further  indicated  the  desirability  of  obtaining  additional  informa¬ 
tion  from  instructors  and  commanding  officers  relative  to  pilot  proficiency. 
Special  mention  was  made  of  the  importance  of  determining  the  relationship 
between  night-vision  tests  and  proficiency  in  night-fighter  pilot  training.  It 
was  stated  that  a  study  of  night-fighter  pQots  should  be  done  to  yield  in¬ 
formation  on  the  requirements  of  instrument  flying.  ' 

Organization 

At  the  time  when  psychological  sections  were  assigned  to  the  four  air 
forces  in  September  1944,  the  operation  of  these  commands  was  directed  fay 
Headquarters,  Army  Air  Forces.  Thus  the  Psychological  Branch,  Research 
Division,  Office  of  the  Air  Surgeon,  dealt  directly  with  the  psychological 
sections  in  the  four  air  forces,  coordinating  their  research  work  and  receiv¬ 
ing  reports  of  progress.  With  the  establishment  of  Headquarters,  Con¬ 
tinental  Air  Forces,  a  commissioned  aviation  psychologist  was  assigned  t# 
the  Office  of  the  Surgeon  on  3  May  1945,  and  took  over  the  detailed  super¬ 
vision  of  the  psychological  sections.  Throughout  the  remainder  of  the  war, 
this  officer  devoted  his  attention  to  bringing  about  a  closer  coordination  of 
resr  rch  on  similar  problems  in  the  four  air  forces.  With  the  exception  of  a 
new  emphasis  on  the  measurement  of  proficiency  of  crews  as  a  whole,  no 
basic  change  in  the  mission  or  operation  of  the  four  air  forces  psychological 
sections  took  place  with  the  establishment  of  this  intermediate  headquarters 
section.  , 

Psychological  personnel  sent  to  the  four  air  forces  in  September  1944 
were  assigned  to  the  Surgeon  in  each  of  these  commands.  Initially,  all  re¬ 
search  personnel  in  the  First,  Third  and  Four  Air  Forces  were  located  in 
these  headquarters,  while  in  the  Second  Air  Force  one  officer  and  two  en¬ 
listed  men  were  immediately  assigned  to  each  of  the  following  subordinate 
wings:  16th  Bombardment  Wing  at  Biggs  Field,  El  Paso,  Tex.,  where  B-l? 
and  B-29  training  were  carried  on;  46th  Bombardment  Wing  at  Ardmore 
Army  Air  Field,  Ardmore,  Okla.,  which  was  engaged  in  heavy  bombardment 
training  using  B-17’s;  15th  Bombardment  Wing  whose  headquarters  was 
located  at  Colorado  Springs,  Colo.,  and  which  was  engaged  in  B-24  train¬ 
ing;  and  72d  Fighter  Wing  at  Peterson  Field,  Colorado  Springs,  Colo., 
which  gave  training  in  P-40  and  P-47  fighter  aircraft.  ■ ' 

Research  personnel  in  the  Third  and  Fourth  Air  Forces  remained  in  the 
headquarters  organization  throughout  the  war,  while  in  the  First  Air  Force, 
a  division  of  personnel  took  place.  One  officer  and  two  enlisted  men  were 
detached  for  a  period  of  90  days  at  Bluethenthal  Field,  Wilmington,  North 
Carolina,  to  study  long  rang.;  fighter  pilot  training.  During  this  period  the 
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301st  Fighter  Wing  requested  that  this  psychological  officer  accompany  the 
Wing  overseas,  which  he  did  on  an  exttnded  tour  of  temporary  duty.  A 
pennant  .it  division  of  personnel  took  pi  ace  on  2  December  1944,  at  which 
time  an  operating  unit  was  established  at  Richmond  Army  Air  Base,  Rich¬ 
mond,  Va.,  to  which  all  personnel,  except  the  Chief  of  the  Section,  and  the 
personnel  on  detached  service,  were  assigned.  This  transfer  was  made  be¬ 
cause  at  that  time  this  base  served  three  functions;  a  bask  fighter  pilot 
training  station,  an  in-processing  base  for  ail  fighter  pilots  reporting  to  the 
First  Air  Force  for  training  and  a  staging  area  for  the  out-processing  of 
fighter  pilot  graduates  for  assignment  overseas.  This  made  it  a  strategic 
location  for  research  operations,  since  psychological  records  could  con¬ 
veniently  bp  initiated,  maintained  and  completed  for  all  student  personnel 
in  the  First  Fighter  Command. 

Personnel 

A  list  of  all  personnel  who  were  assigned  to  the  psychological  sections  in 
the  Continental  Air  Forces  at  any  time  during  the  existence  of  these  sections 
is  given  in  table  1.1.  This  roster  is  organized  in  terms  of  air  force  units  and 
gives  the  name,  rank,  army  serial  number  and  station  for  each  officer  and 

cnlkterl  rrmn 

Specific  Types  of  Projects  Undertaken  in  Each  Air  Force 

In  the  main  body  of  this  report  «*a  attempt  will  be  made  to  present  an 
integrated  picture  of  the  results  of  research  in  the  psychological  units  of  all 
four  air  forces,  organized  in  terms  of  the  findings  about  certain  aircrew 
positions,  and  in  relation  to  particular  research  problems.  It  is,  therefore, 
believed  appropriate  to  present  in  this  section  a  brief  account  of  the  types 
of  projects  undertaken  in  each  air  force  to  show  how  each  psychological 
unit  went  about  the  fulfillment  of  its  general  and  specific  miwimn 

First  Air  Fore* 

Since  research  personnel  in  the  First  Air  Force  were  directed  to  give 
primary  attention  to  fighter  pilots,  a  procedure  was  early  established  for 
following  all  student  pilots  through  their  entire  training  in  the  First  Fighter 
Command.  A  basic  population  file  was  created  with  a  card  for  each  student 
containing  two  types  of  iniormation:  personnel  data  and  proficiency  meas¬ 
ures.  In  the  first  category  appeared  the  student’s  name,  rank,  officer  serial 
number,  name  of  last  Training  Command  School  and  date  of  departure  ~ 
therefrom,  names  of  each  First  Fighter  Command  Station  to  which  assigned 
and  dates  of  departure  from  these,  stanines  of  all  specialties,  testing  number 
and  the  Training  Command  Class  number.  Under  proficiency  measures 
were  presented  all  available  proficiency  data.  A  complete  file  was  main¬ 
tained  for  all  students  entering  training  on  or  after  25  March  1944  kept  up 
to  date  until  the  end  of  hostilities.  The  file  served  as  a  basic  research  toed 
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for  sttHW  of  reliability  of  criteria  and  for  validation  of  selection  proce¬ 
dures.  Among  the  studies  accomplished  were  analyses  of  the  errors  is 
recording  and  distributions  of  gunnery  scores,  and  studies  of  their  rdkbS- 
ties  and  of  the  displayed  on  successive  gunnery  missions.  Two 

other  types  of  criteria  already  in  use  at  certain  training  bases  were  located 
and  studied:  mission  grades  and  comments,  and  records  of  landings  and 
take-offs  kept  by  mobile  control  units.  A  great  deal  of  attention  was  given 
to  the  development  of  certain  over-all  proficiency  measures.  Printed  ratbag 
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Dietsch,  Robert  W . 

Jentlla,  Herbert  E-. . . 

Oman,  Herbert  T.  A. . 

Rokeacb,  Milton . 

Shepard,  Clarence  E. . 

Petti,  Henry  E. . 

Cri'aer,  Dorothy . 

Ft* rtk  Ak  Farm 

Ghiaelli.  Edwin  E. . 

Hcyns,  Roger  W . 

Payne,  Robert  B . 

Tmbaut,  John  W . 

Matthewv  Jack . 

Sblien,  John  M . 

Woodrufl,  Joaeph  L. . 

Whittier,  william  C . . 

Minium,  Edward  W . 

Meadell,  Ira  C . 

Schwarts,  Ralph  H. . 

Thomas.  Garth  J . 


.  Y.  and  Ridtewd  AAR.  Ta- 
.  Y.  and  Richroawd  AAR,  Ta. 
.  Y.  and  Rirhaafd  MB,  Bin. 

*  andRictemdAAB.B*. 
andRicb— dAA£Ra. 


Y.  and 


,  and  Rlchm— d  AAB.  Ba. 
,  and  Rath— d  AAR,  Ta 


Colorado  Spring!,  Cola  , 

In.,  I7tn  TOT  wSg.  Skmx  G*y  AAR,  la.  >nd 
JtCol«»doSorino,G4m 
iq.  15th  Bdr  Wine,  CokradoSpte*  Cain, 
and  Ho,  2AF,  Colorado  Sprint*.  C*a 


tea 


,  Colorado 


Hq.  16th  EOT  Win*,  Biggs  FVdd.  Tra.  and 
Hq.  iAF,  Colorado  Sptnn,  tea 
Ea, 17th  BOT  Wine.  SknaOtyAAB,  la  and 
Hq,  IAF,  Colorado  Sptinga^tea, 

Hq,  l6th  BOY  Wine.  Biggs  txkLTum  aad 
Hq,  IAF.  Colorado  Spnga  tea 
Hq,  72d  Wine.  Peterson  Fidi  Coin. 

Hq.  15th  BOT  Wine.  Colorado  SgsiMa  tea 
and  Hq,  2AF.  Colorado  Spdsga  tea 
Hq,  JAF,  Tampa.  Fla 
Hq.  JAF.  Tampa,  Fla 
Hq.  JAF,  Tampa  Fla  . 

Hq.  JAF,  Tampa  Fla 
Hq.  JAF,  Tampa  Qa 
Hq.  JAF,  Tampa  Fta. 

Hq.  JAF,  Tampa  FK.  .  .  . 

Hq.  JAF,  Tampa  FJa 
Hq.  JAF.  Tampa  Fla 
Hq.  JAF,  Tampa 
Hq.  JAF,  Tampa  FW- 
Hq.  JAF,  Tampa  Fla 

Hq,  iAF,  San  Frnndacn,  CaHL 

Hq .  iAF,  San  Frnnqaca,  OHL 

Hq,  iAF.  San  Frnaoaco,  Caja 

Hq,  4AF,  San  Franctsca  Ca£L  ‘ 

Hq.  4AF,  San  F randan,  CaSL 

Hq,  iAF,  Saa  Frandacn,  CaHL 

Hq.  4AF,  San  Fraacaca  CaHL 

Hq,  iAF,  Sts  Frandaca  CabL 

Hq.  iAF.  San  Frasqaco,  CaHL 

Hq,  «AF.  Saa  Franoaco,  Calif. 

Hq.  'AF,  Saa  Frnaqaco,  CaljL 
Hq.  iAF,  Saa  Franoaco,  CaHL 


7QJJJ&— 47— I 


9 


scales  for  bask  and  advanced  fighter  pilot  training  were  devised,  analyzed 
and  used  in  validation  studies,  and  later  a  technique  was  developed  for 
obtaining  proficiency  ratings  from  interviews  with  instructors.  Accidents 
were  analyzed  in  terms  of  psychological  causes  and  were  used  for  validation 
studies.  A  procedure  was  worked  out  to  isolate  groups  of  students  of  high 
and  of  low  proficiency,  in  terms  of  all  available  criteria,  to  be  used  in  ex¬ 
tensive  validation  studies. 

Second  Air  Pares 

Psychological  research  in  the  Second  Air  Force  went  through  four  phases. 
Preliminary  exploration  of  the  relation  between  aptitude  scores  and  the  de¬ 
gree  of  success  in  operational  training  was  made  by  one  officer  while  on 
temporary  ;'uty  from  the  Training  Command.  Validation  studies  ii'Hng 
records  of  Flying  Evaluation  Boards  and  proficiency  ratings  by  instructors 
and  directors  of  training  on  pilots,  copilots,  navigators  and  bombardiers  in 
heavy  bombardment  training  were  dene  during  this  period.  The  «rond 
phase  began  with  the  arrival  of  other  research  personnel  on  permanent  as¬ 
signment,  and  was  characterized  by  a  detailed  exploration  of  the  types  of 
proficiency  measures  available  in  fighter  and  heavy  bombardment  training. 
The  reliabilities  of  all  available  criteria  were  studied  and  the  usefulness  of 
simple  ratings  and  rankings  was  evaluated.  During  this  period,  in  coopera¬ 
tion  with  the  Operations  Analysis  Section  of  Operations  and  Training, 
plans  were  drawn  up  for  the  selection  and  training  of  outstanding  crews  as 
potential  lead  crews.  These  plans  failed  to  obtain  the  approval  of  higher 
headquarters  and  were,  therefore,  not  put  into  operation.  In  a  third  phase, 
beginning  in  the  early  part  of  1945,  research  activities  were  gradually, 
shifted  from  heavy  to  very  heavy  bombardment  training.  Time  was  spent 
in  the  analysis  of  criterion  data  already  obtained  and  in  a  further  study  of 
the  problem  of  selecting  potential  lead  crews.  In  May  1945  a  fourth  chang* 
in  emphasis  occurred,  when  all  personnel,  other  than  those  assigned  to 
fighter  pilot  studies,  worked  on  the  problem  of  measuring  the  proficiency 
of  B-29  crews.  Descriptive  rating  scales  were  developed  for  the  assessment 
of  proficiency  of  the  crew  as  a  whole  and  of  each  of  its  members.  These 
were  tried  out  at  selected  OTU  and  CCTS  bases.  These  latter  studies  rep¬ 
resented  part  of  a  coordinated  research  program  in  the  Second,  Third  and 
Fourth  Air  Forces  on  development,  of  standard  measures  of  crew  proficiency 
to  be  used  throughout  the  Continental  Air  Forces  in  furnishing  overseas 
commanders  with  information  on  replacement  crews,  and  in  validating  crew 
selection  procedures  being  instituted  at  that  time  in  the  Training  Command. 

Third  Air  Pores 

Research  personnel  of  the  Third  Air  Force  spent  the  first  three  months 
after  assignment  completing  their  survey  of  the  qualifications  of  returned 
combat  personnel  for  further  duty.  During  visits  made  to  all  Third  Air 
Force  stations  in  connect  >n  with  this  work,  psychologists  made  observa- 
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tions  on  procedures  used  in  assessing  proficiency.  A  second  major  project 
was  undertaken  in  fulfillment  of  the  section’s  directive  to  study  problems;  in 
leadership.  The  section  made  two  surveys  of  airplane  commander  ability 
and  set  up  and  operated  practical  procedures  for  the  assembly  of  heavy 
bombardment  (B— 17)  crews  on  the  basis  of  compatibility.  At  the  direc¬ 
tion  of  the  Commanding  General,  Third  Air  Force,  a  service  project  was 
completed  on  the  utilization  of  negro  personnel,  and  another  survey  on  the 
disposition  of  aircrew  trainees  in  the  Third  Air  Force  was  done  at  the  sug¬ 
gestion  of  the  Office  of  the  Air  Surgeon.  Coincident  with  these  studies 
analyses  were  made  of  the  relation  between  stanines  and  disposition  fay 
Flying  Evaluation  Boards,  and  also  the  occurrence  of  accidents.  During 
the  last  few  months  of  the  war,  Third  Air  Force  psychologists  undertook 
the  development  of  specific  proficiency  measures  for  a  variety  of  aircrew 
duties  and  participated  in  the  general  research  program  on  the  measure¬ 
ment  of  crew  proficient  which  was  directed  from  Headquarters,  Con¬ 
tinental  Air  Forces. 

Fourth  Av  Force 

Upon  assignment  to  Headquarters,  Fourth  Air  Force,  research  personnel 
initiated  a  systematic  approach  to  the  fulfillment  of  the  section’s  mission  in 
a  series  of  studies  of  P-38  fighter  pilot  and  B— 24  heavy  bombardment 
training  These  included  job  analyses,  studies  of  the  adequacy  and  reliabili¬ 
ties  of  existing  criteria,  validities  of  stanines  and  test  scores  and  studies  in 
the  learning  or  forgetting  of  aircrew  skills.  Completion  of  these  projects 
occupied  most  of  the  year  .  Criterion  and  validation  studies  were  also  done 
on  P-61  night-fighter  pilots.  Assistance  in  the  validation  of  tests  and 
stanines  for  a  large  number  of  P-38  pilots  was  received  from  the  Analysis 
and  Records  Section  of  AAF  school  of  Aviation  Medicine,  Randolph  Field, 
Texas.  During  the  summer  of  1945  the  Fourth  Air  Force  also  participated 
in  studies  of  B-29  crew  and  individual  proficiency  measurement  Research 
was  begun  at  the  B-29  lead  crew  training  school  at  Muroc  Army  Air  Field, 
Muroc,  Calif.,  an  installation  operated  jointly  by  the  Fourth  Air  Force  and 
the  Twentieth  Air  Force,  to  which  Hected  crews  were  returned  from  the 
Marianas  for  a  period  of  intensive  lead  crew  training.  Assistance  was  ren¬ 
dered  to  operations  analysts  and  to  operations  and  training  personnel  at  the 
School  in  the  construction  of  rating  scales  and  studies  were  done  by  the 
psychological  section  of  the  reliability  of  the  ratings  obtained. 

Comments  on  the  Conduct  of  Research  Operation* 

In  the  follow-up  studies  made  by  all  four  air  forces  the  general  proce¬ 
dures  were  roughly  the  same.  Personnel  of  each  psychological  section  or 
subsection  visited  training  bases,  procured  data  from  the  squadron  opera¬ 
tions  office,  and  elicited  the  cooperation  of  instructors  and  other  training 
-  personnel  in  making  ratings  and  discussing  problems  of  proficiency  measure¬ 
ment.  hi  addition  to  the  cooperative  relations  maintained  with  training  per¬ 
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ionnel,  psychologists  made  bdpful  contacts  with  operations  analysts,  statis¬ 
tical  control  sections  and  personnel  engaged  in  accident  analysis.  Mention 
has  already  been  made  of  certain  projects  carried  on  jointly  with  operations 
analysts.  From  their  professional  point  of  view,  operations  analysts  saw 
and  appreciated  many  of  the  problems  which  interested  psychologists. 
Statistical  control  personnel  furnished  useful  rosters  and  in  some  cases  sup¬ 
plied  statistical  aid  with  IBM  equipment.  From  accident  analysis  sections, 
psychologists  obtained  over-all  summaries  of  accident  data,  specific  accident 
reports  and  information  about  causes  and  classification  of  accidents.  Re¬ 
search  personnel  also  made  useful  contacts  with  various  other  sections  at  all 
echelons  of  command. 

Certain  characteristics  of  the  training  mission  of  the  Continental  Air 
Forces  presented  rlifficulties  to  the  psychologists  in  the  accomplishment  of 
!  icir  mission.  Many  problems  had  their  basis  in  the  fact  that  in  operational 
training  there  was  little  interest  in  differences  in  individual  ability  above 
a  certain  minimum  satisfactory  level  of  performance.  This  lack  of  interest 
was  due  largely  to  the  commitment  system  which  required  the  air  forces  to 
prepare  crews  and  individuals  for  combat  in  the  largest  possible  numbers. 
Quotas  assigned  made  little  allowance  for  the  elimination  of  any  individuals 
other  than  those  who  weie  obviously  below  minimum  proficiency  levels. 
Thus,  even  though  training  personnel  recognized  a  considerable  range  in 
ability  among  students,  less  than  three  percent  of  all  trainees  were  re¬ 
evaluated  because  of  poor  performance.  However,  the  small  percentage  of 
students  found  really  unsatisfactory  also  reflects  in  part  the  rigid  pre¬ 
selection  which  occurred  in  the  AAF  Training  Command.  That  such  selec¬ 
tion  was  taking  place  was  known  to  many  training  officers  who  then  expected 
that  most  of  the  students  assigned  to  operational  training  could  be  able  to 
and  would  perform  in  a  satisfactory  maimer. 

As  a  result  of  the  lack  of  emphasis  upon  or  need  for  discriminating 
among  students  with  regard  to  proficiency,  few  accurate  records  of  individ¬ 
ual  performance  were  maintained.  Research  personnel  obtained  whatever 
objective  scores  were  available  including  fixed  gunnery,  skip  and  dive  bomb¬ 
ing  scores,  circular  error  in  bombing,  records  of  camera  and  radar  bombing, 
gun  camera  records  and  many  others.  The  adequacy  and  reliability  of  these 
various  measures  are  discussed  in  appropriate  sections  of  this  report. 

The  measurement  of  the  proficiency  of  the  crew  as  a  whole,  in  contrast  to 
or  in  addition  to  the  assessment  of  the  individual  crew  members,  was  not 
done  at  all  by  training  personne:  except  in  the  research  procedures  initiated 
and  supervised  by  the  research  sec/ions  in  the  various  air  forces. 

Another  source  of  problems  coni  footing  research  personnel  was  the  varia¬ 
tion  in  training  from  one  station  and  class  to  another.  These  variations 
were  in  amount  of  training  (hou  .,  missions)  and  in  emphasis  on  different 
aspects  of  the  curriculum.  Varia  .on  occurred  from  one  station  to  another 
and  from  one  class  to  another  a .  the  same  station.  Direct  comparisons  of 
groups  on  the  basis  of  the  rec .  ds  were,  therefore,  impossible  and  large 
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scale  follow-up  studies  were  difficult.  Irregularities  in  the  amount  of  train* 
ing  received  by  students  were  caused  by  delays  In  the  formation  of  crews 
when  individual  specialists  failed  to  arrive  on  schedule  at  the  training 
by  foreshortening  of  the  training  program  to  meet  overseas  movement  re¬ 
quirements,  and  by  delays  due  to  maintenance  difficulties.  Irregularities 
from  station  to  station  in  the  emphasis  on  different  parts  of  the  curriculum 
had  two  main  causes.  A.  trend  toward  decentralization  with  delegation  of 
responsibility  for  detailed  training  procedures  to  the  station  level  character¬ 
ized  Continental  Air  Forces  training,  and  probably  resulted  from  the  eariy 
mission  of  continental  air  force  units  in  tactical  and  defense  operations. 
This  trend  was  somewhat  reversed  toward  the  end  of  the  war.  A  second 
reason  for  differences  in  emphasis  was  the  fact  that  instructors  were  drawn 
in  increasing  numbers  from  the  ranks  of  aircrew  members  returned  from 
overseas.  Their  experiences  in  the  combat  zone  largely  determined  which 
phases  of  training  they  thought  most  important  Since  they  came  from  dif¬ 
ferent  theaters,  their  views  reflected  differences  in  tactics  employed  in  these 
theaters.  Thus,  in  completing  the  follow-up  studies,  aviation  psychologists 
had  to  resort  to  several  different  procedures  to  correct  for  differences  in  the 
range  and  the  absolute  values  of  proficiency  scores  obtained  from  different 
bases. 

ORGANIZATION  OF  THE  REPORT  * 

The  basic  orientation  of  the  Aviation  Psychology  Program  toward  the 
individual  aircrew  position  is  reflected  in  the  subsequent  organization  of  this 
report  The  first  group  of  chapters  is  devoted  to  each  aircrew  specialty 
found  in  the  Continental  Air  Forces,  outlining  the  job  requirements,  meth¬ 
ods  for  measurement  of  proficiency  in  the  specialty,  and  the  relation  of 
achievement  of  individuals  on  selection  and  classification  tests  to  measured 
performance  on  the  job.  The  amount  of  space  given  to  each  is  a  function  of 
the  amount  of  research  data  accumulated  during  the  emergency  period,  and 
does  not  necessarily  correspond  to  the  relative  importance  of  that  aircrew 
position  within  the  crew  or  in  the  tactical  formation.  Following  these  Is  a 
chapter  on  the  crew  as  a  whole  which  discusses  the  pi  ~*blem  of  evaluating  a 
crew  as  a  working  team,  achieving  a  common  goal,  rather  than  as  a  collec¬ 
tion  of  specialists.  Subsequent  chapters  recount  those  studies  which  were 
undertaken  somewhat  aside  from  or  incidental  to  the  major  objectives  of 
the  program. 


13 


CHAPTER  TWO _ 

Fighter  Pilot  Studies 


ANALYSIS  OF  DUTIES 

Although  the  detailed  analysis  of  the  fundamental  job  of  the  pQot  was 
felt  to  be  the  responsibility  of  the  Psychological  Research  Project  (Pilot) 
in  the  AAF  Trait  ng  Command,  some  study  of  the  training  requirements 
?  '  i  duties  of  the  fighter  pilot  in  operational  training  was  obviously  neces¬ 
sary.  In  the  discussion  which  follows,  those  aspects  of  the  requirements  are 
stressed  whic are  peculiar  to  operational  training  and  combat  No  attempt 
is  made  to  present  a  detailed  statement  of  training,  since  this  varied  from 
time  to  time,  and  also  can  easily  be  obtained  from  the  appropriate  training 
manuals  and  directives.  Rather,  emphasis  is  placed  upon  the  results  of 
studies  made  to  obtain  information  about  the  qualities  necessary  for  success, 
and  upon  those  activities  of  the  pilot  which  yielded  criteria  of  proficiency. 

Job  Deseripticm 

Information  about  the  jcb  of  the  fighter  pilot  in  operational  training  was 
obtained  from  many  sources:  Training  Standards,  manuals,  training  direc¬ 
tives,  conferences  with  instructor  3,  observations  of  certain  aspects  of  train¬ 
ing  and  conversations  with  pilots  who  had  had  combat  experience.  Below 
is  given  a  brief  outline  of  fightei  pilot  training  requirements  as  obtained 
from  these  sources.  Additional  ii  formation  is  given  under  the  section  on 
criteria  where  more  detailed  descr'  Jtions  are  given  of  those  operations  and 
requirements  which  yielded  data  v  ed  as  criteria  of  proficiency. 

Combat  training  guides  for  P-  7,  P-40  and  P-38  type  aircraft  were 
found  respectively  in  I  Fighter  Co  rmand  Circular  50-8  with  amendments, 
in  Second  Air  Force  Manual  50-6' 1  revised  from  time  to  time,  and  in  4th 
Fighter  Command  MemorancJ  .m  4'-8  also  revised.  Minimum  requirements 
in  each  case  included  120  hoars  ol  flight  training  spread  over  a  10-  to  12- 
week  period.  In  addition,  e  1  ch  student  took  ground  courses  covering  such 
subjects  as  navigation,  con  inunications,  meteorology,  tactics  combat  in¬ 
telligence,  gunnery  and  othe . .  The  numbers  and  type?  of  missions  and  the 
organization  of  flight  traini  1 ;  varied  somewhat  for  t^e  different  types  of 
aircraft  and  in  the  different  ommands  involved.  For  example,  with  P-38 
aircraft,  training  was  at  fir  divided  into  two  phase:-  taken  at  different 
stations.  Later  all  P-38  tra  1  ing  was  done  at  the  same  stations  and  phase 
distinctions  were  dropped.  the  Second  Air  Force  th»  P-40  and  P-47 
training  bad  no  phas<  divisic  1  except  that  all  missions  in  aerial  and  ground 
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guunery,  rocket  firing,  and  dive  bombing  were  usually  done  at  special  gun¬ 
nery  stations  to  which  pilots  were  assigned  for  short  periods.  Finally,  P-47 
training  in  the  First  Air  Force  was  divided  into  two  phases,  basic  and  ad¬ 
vanced,  taken  at  different  stations. 

In  the  early  part  of  training  (basic  phase)  emphasis  was  on  famfliarira- 
tion  with  the  operation  of  the  aircraft  and  on  the  simpler  combat  maneu¬ 
vers.  Experience  was  given  in  missions  ait  different  altitudes;  and  oxygen 
equipment  and  the  anti-G  suit  were  tried  out  in  appropriate  maneuvers. 
Individual  and  unit  combat  was  practiced  and  some  night  flying  done.  In 
the  later  part  of  flying  training  (advanced  phase)  were  included  more  com-' 
plex  maneuvers,  further  experience  in  formation  flying,  training  in  gunnery, 
strafing,  bombing,  low  altitude  navigation  and  night  flying.  “Combined 
training,”  involving  coordinated  missions  with  bombardment  type  aircraft, 
was  an  important  part  of  this  training. 

In  addition  to  the  requir'd  missions,  several  hours  of  unspecified  flying 
were  allotted  in  the  directives,  allowing  individual  stations  to  supplement 
the  required  missions  according  to  local  needs.  Differences  in  the  use  of 
this  time  and  differences  in  facilities  and  conditions  existing  at  differed 
stations  tended  to  make  training  less  homogeneous  than  would  be -indicated 
by  statements  found  in  the  training  directives.  Such  variations  in  training 
added  greatly  to  the  difficulties  met  in  obtaining  adequate  criteria  of 
proficiency  of  the  individual  pilot. 

Job  Specifications 

The  factors  involved  in  flying  fighter  type  aircraft  may  be  separated 
into  two  categories.  They  are  skills  and  traits .  This  is  admittedly  an 
arbitrary  division,  but  seems  to  be  one  which  permits  an  efficient  handling 
of  the  available  data.  The  term  skill  is  in  general  applied  to  a  psychomotor 
response  in  a  flying  situation.  The  term  trait  is  used  in  the  discussion  of 
modes  of  behavior  which  appear  to  spring  irora  the  psychological  back¬ 
ground  of  the  pilot.  An  example  of  a  skill  is  a  “quick  rejoin”;  and  an  ex¬ 
ample  of  a  trait  is  “aggressive  in  the  air.”  The  information  about  both  the 
skills  and  the  traits  important  for  success  as  a  fighter  pfloc  was  obtained 
from  a  number  of  sources.  In  the  discussion  which  follows,  these  skills  and 
traits  axe  discussed  separately  according  to  source  from  which  the  informa¬ 
tion  was  obtained.  The  over-all  picture  provided  by  the  traits  and  skills 
described  in  this  section  may  be  thought  to  furnish  a  rough  set  of  job 
specifications  for  the  successfu1  fighter  pilot 

Skills 

1.  General  analysis  of  skills. — Aviation  psychologists  in  the  Fourth  Air 
Force  obtained  information  as  to  what  were  the  most  important  flying  skills 
for  P-38  fighter  pilots  from  four  main  sources  of  information:  “Hangar 
Flying,”  or  interviewing  flying  personnel;  study  of  training  regulations; 
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iMnlsatioB  case  records;  and  a  perinwiMPy  raring  scale.  The  ftit  bled 
bdwr  represent  a  psychological  assessment  of  the  iafocaariou  obtained  bon 

a.  Abffty  to  fiy  dost  formtfim  without  losing  position  as  a  read  of 
hggicg.  falKnf  cot  on  tarns  and  erratic  throttle  control,  failure  to  begin 
meww  promptly,  defaiflriag  on  maneuvers,  failing  to  maintain  pre¬ 
scribed  altitude,  and  over-controSng. 

b.  Ability  to  locate  tad  fire  at  air  targets,  estimating  united;  the  aSgn- 
ft,  lead,  angle  tad  ras^e  without  slipping  or  skidding,  and  sing  tm> 


c.  Ability  to  identify  tad  fare  tt  grouped  targets,  ertirrvring  correctly  the 

proper  line  of  flight,  range  and  upe,  coordinating  ccalroh,  and  crntroMng 
*  -» dfcctr 

d.  Ability  :  ,  erf  on »  acrobatic  wuaonert  as  prescribed,  without  default¬ 
ing  o'  ^  g  posiiioii,  demonstrating  a  knowledge  of  the  performance 
-char  s  otks  of  the  airplane. 

t  ..bQity  to  locate  a*d  bomb  grtmad  targets  with  proper  use  of  equip¬ 
ment  2nd  -  _bnKpsea. 

.  ..fission  cord  comments. — An  analysis  of  factors  concerned  with  «y-g 
the  f -47  was  made  by  research  personnel  in  First  Air  Fcree  from  instructor 
comments  on  mission  cards.  There  were  eight  types  of  cards,  covering  the 
following  mixsfcr  is  the  basic  phase  of  training:  transition,  formation, 
navigation,  instrument,  acrobatics,  combat  maneuvers,  night  flying  and 
aoss-cotmtiy.  The  comment*  were  voluntary  additions  to  the  grading  of 
the  missions.  During  the  course  of  instruction,  a  student  pdot  was  graded 
on  different  misstons  by  6  to  10  instructors,  usually  several  times  by  —Hi 
For  a  sample  of  2U0  cases  with  a  minimum  of  10  cords  and  a  mmimmii  total 
of  5  comments,  the  analysis  shown  in  table  2.1  was  obtained.  It  must  be 
said  that  the  categories  are  probably  to  a  large  degree  a  function  of  the  type 
of  flying.  Since  the  missions  covered  the  basic  flying  phase,  care  must  be 
exercised  in  drawing  any  general  conclusions  for  all  types  of  flying.  The 
comments  were  analyzed  into  three  categories:  favorable  comments,  neutral 
remarks,  and  major  criticisms.  Distributions  of  the  favorable  and  unfavor¬ 
able  comments  for  different  aspects  of  flying  are  shown  below.  The  cate¬ 
gories  are  not  mutually  exclusive,  but  represent  the  best  grouping  of  the 
comments  that  could  logically  be  decided  upon.  It  is  dear  from  ibe  data 
that  instructors  tended  to  comment  favorably  upon  rather  than  criticize 
mission  performance  by  a  ratio  of  two  to  one.  They  apparently  considered 
formation  flying  in  general  (unspec.),  technique  of  rejoining  formations  in 
particular,  and  landing  technique  as  the  most  important  skills  in  operational 
training  for  fighter  pilots. 

3.  Deficiencies  reported  for  pilots  t  eeting  fiying  evaluation  boards. — 
Research  personnel  in  the  Fourth  Air  Ft  ce  made  a  study  of  case  reports  of 
student  pOots  who  appeared  before  FT  ng  Evaluation  Boards  because  of 
lack  of  proficiency  in  flying  P-38,  P-3>,  and  P-61  aircraft.  Of  33  day- 
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fighter  student*  re-evaluated,  IS  were  unsatisfactory  hi  formation  flying. 
Fourteen  of  the  others  were  reported  as  having  more  general  deficiencies 
such  as  poor  judgment,  slow  reaction  time,  etc,  some  of  which  might  bo 
considered  skills  and  others  more  nearly  represented  traits.  Three  incfivid> 
sib  were  evaluated  because  of  recklessness  or  carelessness  and  one  because 
of  fear.  A  more  detailed  analysis  of  the  flying  deficiencies  of  these  and  three 
other  students  is  given  in  table  2.2  which  lists  the  frequency  of  reporting 


Tins  2.1. — MeJdine  frequencies  *f  JcvnnbU  mi  mimmwbU 
comments  m  emssim  cmris 


of  fa<*h  of  several  categories  of  deficiencies.  The  data  show  several  defi¬ 
ciencies  were  reported  for  some  of  these  student  pilots.  Deficiencies  in 
«vm«  were  apparently  reported  abo  jt  twice  as  frequently  as  trait  deficiencies 
in  the  student  pilots  considered  for  re-evaluation.  In  the  discussion  under 
traits,  it  will  be  shown  that  many  of  the  observed  deficiencies  in  skills  were 
actually  thought  by  instructors  and  flight  surgeons  to  be  caused  by  trail 
deficiencies.  Hence,  no  great  weight  should  be  given  to  the  relative  fre¬ 
quencies  with  which  traits  and  skills  were  given  as  official  reasons  for  ie- 
'  evaluation. 

Since  formation  flying  was  so  frequently  reported  as  a  reason  for  re- 
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evaluation,  a  special  analysis  was  made  of  deficiencies  reported  in  this 
category.  The  results  are  given  is  table  2J. 

Finally,  the  principal  flying  deficiencies  resulting  in  Flying  Evaluation 
Board  Action  were  examined  for  13  re-evaluated  night-fighter  students.  AD 
but  three  of  these  were  reported  as  failing  to  meet  night-fighter  instrument 
standards,  probably  largely  a  matte*  of  deficiencies  in  skills.  One  each  was 
re-evaluated  for  over-cautiousness,  lack  of  confidence,  and  “poor  pilot 
technique." 

Table  22. — , Specific  deficiencies  reported  for  tkirty-dx  students 
considered  for  rt-eveiuetion 
FOCETB  Aflt  fOaCS 

Deficiencies  Frequency 

Skills: 

Specific  flying  situations: 

Fonnation  flying  . 22 

Acrobatics  . S 

Gunnery  patterns . 2 

landings  . 2 

Total . ; . . . ~n 

Flying  technique: 

Slow  progress  (slow  learning)  .  S 

Slow  reaction  time  .  7 

“Below  minimum  standards” .  4 


Poor  coordination  .  2 

Roughness  in  control  . 1 

Ovjrcontrol  . 1 

Total  . *24 

Total  skills  . ~5S 


Traits: 

Dangerous,  reckless,  careless .  S 

Poor  judgment  . 4 

Lacks  discipline  . 4 

Lacks  confidence  .  4 

Too  cautious  and  deliberate  . .  I 

Lacks  aggressiveness  ...^ . 2 

Poor  attitude  toward  his  duties  . 1 

Total ,  traits  . H 

4.  Student  errors  noted  by  mobile  control  unit  observers.-^-ln  the  First 
and  Second  Air  Forces  violations  noted  by  the  observer  in  the  mobile  con¬ 
trol  units  were  used  as  a  criterion  of  pilot  proficiency.  Research  personnel 
in  the  First  Air  Force  selected  as  a  sample  the  violations  of  100  students 
over  a  30-day  period  for  an  analysis  of  landing  and  take-off  errors.  As  might 
be  expected,  there  are  some  cas.j  of  overlapping  in  the  categories  used. 
For  instance,  in  landing  it  was  usial  that  the  approach  was  low  if  the  base 
leg  and  final  turn  were  low.  Als  •  if  the  approach  was  “hot,”  the  landing 
was  most  apt  to  be  “hot.”  In  erne  cases,  the  decision  as  to  where  the  - 


error  was  reported  was  based  on  whether  or  not  the  pilot  actually  landed 
or  was  instructed  to  go  around.  For  example,  the  former  might  be  reported 
as  a  “hot”  landing,  while  the  latter  was  reported  a  “hot**  approach,  la 
table  2.4  is  presented  the  distribution  obtained. 

Traits 

1.  General  analysis  oj  traits. — An  obvious  source  of  information  about 
traits  important  for  success  as  a  fighter  pilot  was  interviews  with  instruc¬ 
tors  and  fighter  pilots  with  combat  experience.  Research  personnel  of  both 

Tails  2  J. — Frequency  distribution  of  criticisms  mode  of  tie  formation  flying 


of  twenty-two  re-evaluated  students 
FOOT  TH  AIR  FORCE 

Criticism  Prtquency 

Failure  to  maintain  position  on  tom: 

Falls  out  on  turns  . 1 

Lags  on  turns  .  2 

Loses  altitude  on  turns . 2 

Only  shallow  turns . . . I 

Total . .~U 

Failure  to  maintain  position  on  maneuvers  other  than  turns: 

Slow  to' join  formation  . 4 

Starts  maneuvers  late  . 2  - 

Lags  in  rat  race . 1 

Poor  acrobatics  . 1 

Lags  on  take-off . .  1 

Total . .*15 

FaQuw  to  maintain  position  in  straight  and  level  flight: 

Straggling,  lagging  .  5 

Erratic  . S 

Failure  to  fly  dose . 1 

Flies  bdow  . 1 

Total . 15 

General  criticisms:  '  ' 

Dangerous  . ’ .  S 

Slow  reaction  time  . 1 

Total . “1 


the  First  and  Fourth  Air  Forces  obtained  considerable  information,  from 
this  source.  In  addition,  training  manuals,  rating  procedures,  and  the  like, 
yielded  information  from  which  inferences  could  be  made  as  to  the  im- 
poitance  of  various  traits.  Th?  following  is  a  list  of  the  most  important  of 
the  traits  identified  by  research  personnel  of  one  or  both  Air  Forces,  to¬ 
gether  with  phrases  offering  brief  trait  descriptions  in  each  case. 

a.  Alertness. — Keeps  continually  alert  while  nying,  spots  installations 
and  other  aircraft  quickly,  makes  quick,  intelligent  responses  to  instructions, 
orders,  signals,  evidences  of  malfunction  in  the  aircraft. 
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b.  Friendliness— Cooperation. — b  cheerful  and  agreeable,  friendly  with 
everyone,  generally  well  liked,  “wean  well,”  is  wOli  *g  to  sacrifice  individual 
desires  In  the  interests  of  combat  teamwork,  shows  no  harmful  individual* 
ism,  is  able  to  work  with  others  routinely  without  friction. 

c.  Eagerness  for  combat. — Has  strong  desire  for  action  with  plane  against 

Taata  lA.—Erron  mode  by  100  lindens  pdoit  emd  noted  by 
mobdo  control  obtonon 
rare  aik  roues 

FUfkt  description  Emmbsr  of 

moot 

tom  he 

Wide,  far  out  . *1 

Low  . •' . >4 

T*a! . 45 

Final  turn:  Low  . 25 

Approach: 

Low  . 74 

Dngged  fa  . 40 

Spadns  too  dw  . 24 

Hot  . 2S 

Hi*h,  orenhet .  17 

Long  . 5 

SBppins  .  5 

Total  . .WO 

LawBag: 

Loaf .  . 29 

Hot  . 20 

Short  . f 

Roujh  (dropped  in)  .  4 

Wheel  . 5 

Total . ~U 

Other:  Wheels  down  late . j 

Tako-off: 

Low  turn  . SJ 

Lon?  (tail  high)  . 5 

Total . ."5 

Total  number  of  errors . 564 

the  enemy,  as  student  is  primp;  and  enthusiastic  about  the  routine  as  well 
as  more  adventurous  tasks,  likes  to  be  on  offensive  in  simulated  combat 
maneuvers,  is  ictively  and  positively  a  vare  of  combat  flying  as  the  goal  of 
operational  training. 

d.  Leaden •  ip.— Accepts  and  discharge  responsibility  well,  is  willing  to 
take  the  leaf  in  new  siturtiuns,  is  respe  ted  by  other  students. 

e.  Air  d«t;‘ fine.— Executes  orders  promptly,  obeys  instructions  and  fol¬ 
lows  flying  regulations,  thinks  and  flies  fti  the  success  of  the  whole  group 
regardless  of  i.  i  lividual  considerations. 
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L  Dependability. — Is  dependable,  ku  ^ 

behavior  b  stable  and  predictable.  ? 

f.  Eadwamce. — Has  physical  and  moral  standee  to  stand  locg  Ions  of 
It^ 

b.  Industrionsness. — Devotes  time  and  energy  to  tnbing  bqeoi  format 
requirements,  b  determined  to  succeed,  pots  into  each  Job  more  dm  b 
required,  extends  himseli  to  kata  new  flying  ptan^nff^  «wy 
and  the  limitations  and  possibilities  of  bb  plane 

L  J loinrity  of  judgment. — Avoids  hazardous,  expensive  practices*  avoids 
thoughtless  violations  of  regulations  resulting  in  xat  of  abezaft, 

follows  advice  of  experienced  pilots. 

j.  Attention  to  deto3. — Has  a  wholesome  respect  for  iWteiUi  pwfr— y 
developed  for  the  safety  of  flying  personnel  and  follows  them  exaefty.  * 

k.  Coinage. — Is  able  to  fly  dose  formation  without  defauftiag  on  dan* 
geroos  maneuvers,  has  few  abortive  mbdoaa. 

L  Military  discipline. — Has  respect  for  superiors,  obeys  regidatiom  and 
orders,  b  prompt,  b  neat,  etc. 

m.  Possibility  of  growth. — Is  able  to  develop  as  new  tasks  ace  given, 
grasps  new  problems,  learns  new  lessons  and  accepts  increasing  respon¬ 
sibility. 

n.  Morale. — Makes  the  best  of  the  situation  in  which  he  finds  btmsctf,  - 
has  no  interfering  personal  worries,  will  cot  let  combat  losses  get  him  doom. 

Obviously,  sod?  of  the  above  traits  considerably  overlap  others.  It  b 
also  likely  that  there  weld  be  disagreement  among  observers  as  to  die  im¬ 
portance  of  many  of  them.  For  traits  identified  in  the  First  Air  Force,  an 
attempt  was  made  to  obtain  evidence  of  both  discreteness  and  overlapping. 
From  interviews  with  combat  pilots,  12  traits  had  been  identified  ns  dif¬ 
ferentiating  the  better  combat  pilots  from  the  poorer.  These  traits  were 
then  ranked  by  the  experienced  pilots  in  the  order  of  their  relative  signifi¬ 
cance.  Comments  were  also  requested  regarding  the  discreteness  of  die 
traits  and  clarity  of  definition.  The  results  are  summarized  in  table  IS. 

Taut  2.5. — Evaluation  of  tr&U  sigmfcaU  lor  tfpUr  ptoU 
rasr  Aia  rones 


(N-u) 


Tnh 

Mmi 

Xuk 

Kclatfc* 

Saab 

A 

Air  diu-i  pi  j  fsd  tftavuti . . . 

1.11 

Eifttaeii  lot  coabit . . ♦ . 

J.t* 

1 

Leadership . . . . . 

*3.*2 

ms 

5.11 

Deciuve&a*. . 

5.54 

5 

Cooli-.:**  . : . 

i.K 

4 

. . . . 

4.15 

7 

Uertacw . . . 

4.M 

• 

Morale . . . 

*1.71 

<D* 

Tough  tWnh  lug . . . . 

«*.» 

U)  t* 

*.15 

11 

Ptnonality . . . 

>.4* 

tr 

1  Number  of  pilot*  who  tuted  tbi*  trait  to  be  th«  nm  •*,  or  t  put  of,  uMk  tnfct  laui. 
•  Helen  to  the  Dumber  of  pilot*  who  it* ted  tU*  trait  to  be  *  lummttioa  of  all  lb*  *tk«  trots 


Oft  the  basis  of  ratings  of  discreteness  shown  in  the  table,  the  traits  of  ag¬ 
gressiveness,  decisiveness,  and  tovgh  thinking  were  combined  with  each 
other  or  with  other  traits  in  the  list.  A  similar  procedure  applied  to  the 
more  extensive  list  from  both  Air  Forces  would  probably  result  in  addi¬ 
tional  consolidation  and  damnation. 

2.  Comments  on  mission  cords. — Since  less  than  5  percent  of  the  mission 
card  comments  referred  to  traits,  the  particular  traits  mentioned  probably 
have  little  significance  “judgment,”  “air  discipline”  and  “cockpit  proce¬ 
dure”  seemed  to  be  the  only  traits  directly  observed  by  the  instructors 
grading  mission  performance.  This  is  perhaps  only  natural  since. a  trait  is 
ordinarily  thought  an  ov^r-all  continuing  characteristic  to  be  inferred  from 
many  observations-  Mission  comments  usually  referred  to  specific  observa¬ 
tions  of  behavl  v  on  a  single  marie*. 

i.  Psychological  causations  of  pilot-trrer  accidents. — Another  method  of 
obtaining  information  about  qualities  important  for  pilot  success  is  to  stndjy 
the  qualities  of  individuals  who  fail,  particularly  those  qualities  that  might 
have  contributed  to  the  failure.  In  a  sense,  pilots  that  have  aircraft  acci¬ 
dents  due  to  pilot  error  may  be  considered  to  have  failed  in  one  aspect  of 
their  job.  Hence,  a  study  of  the  psychological  reasons  for  such  *rri«Vnty 
would  seem  to  be  worth  while. 

An  analysis  of  P-47  pflot-error  accidents  in  terms  of  probable  psycho¬ 
logical  causation  was  made  by  the  First  Air  Force  research  personnel  from 
the  data  recorded  on  the  accident  reports  sent  in  to  Headquarters,  I  Fighter 
Command.  The  examination  of  the  individual  accident  records  consisted  of 
two  steps.  The  first  involved  abstracting  aft  pertinent  information  from  the 
records  on  each  case.  When  all  records  had  been  abstracted,  each  care  was 
taken  up  for  analysis  by  a  committee  of  three  to  five  men.  Each  member, 
working  independently,  made  his  own  assessment  of  probable  psychological 
causation  from  the  information  on  the  accident  in  the  ab' traded  record. 
Following  this  step,  differences  in  assessment  of  a  psychologies-  trait  were 
discussed  and  eliminated  in  the  committee.  A  summary  table  of  the  psycho¬ 
logical  categories  and  their  relative  frequencies  is  presented  in  tab’is  ?.6.  A 
similar  procedure  yielded  somewhat  different  results  in  a  study  of  10b 
secutive  P-47  accidents  in  the  Second  Air  Force.  Data  from  this  analysis 
are  also  shown  in  table  2.6.  The  relative  frequencies  of  different  categories 
of  reasons  in  the  twe  distributions  are  somewhat  different.  Either  the  nature 
of  the  accidents  was  different  in  the  two  commands  or  the  psychologists 
differed  markedly  in  their  interpretation  of  the  reports, 

4.  Reasons  for  frying  evaluation  board  action. — Studies  of  reasons  given 
for  re-evaluation  of  fighter  pilots  by  Flying  Evaluation  Boards  in  the  Fourth 
Air  Force  indicated  that  traits  were  reported  approximately  one-half  as 
often  as  skills.  {See  table  2.3,  page  8).  However,  in  the  reports  traits  were 
frequently  listed  as  exp1  inations  or  reasons  for  the  lack  of  skill  reported.  In 
table  2.7  are  given  the  explanations  in  terms  of  traits  offered  by  flight  sur¬ 
geons  and  instructors  for  deficiencies  in  skill  that  were  reported.  Thus, 
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although  more  than  half  of  the  re-evaluations  were  ascribed  to  of  »kJ*, 
it  was  apparently  believed  unfavorable  traits  were  fundamentally  respon¬ 
sible  in  most  eases. 

S.  Study  of  traits  ou  the  Minnesota  personality  inventory  m  relation  to 
accidents  and  flying  evaluation  board  action. — As  a  cooperative  project 
with  the  psychiatrist  at  the  P-47  Fighter  Pilot  Wing  Indoctrination  Wait 
in  the  Second  Air  Force,  the  Minnesota  Multiphasic  Personality  Inventory 
was  administered  to  all  incoming  trainees  and  combat  returnees  in  the  fa* 
of  1944.  Data  are  available  for  this  population  on  the  incidence  of  aircraft 
accidents  and  elimination  froa  training  by  FEB  action.  It  was  th^nght  that 

Taux  IJA.—Fsychdte^cd  cornu*  contributing  to  piot-errer  trident* 
Cuison  or  faciacqctt  Ctounw 
Fkst  An  Fo>r*  Stady 


Speed-distance  mhntralatkm  .  41  j§ 

Inciiitiow  phoning  .  94  2S 

Poor  divisiea  of  »tt  ration .  35  2S 

Reaction  after  nnpooed  emergency . 27  17 

a.  Speed-distance  mbcakuhtk*  .  (9)  (6) 

b.  Poor  handBng  of  aitpbuK . . . (IS)  (£2) 

Poor  plant  judgment  . 9  t 

iwtiMWft  . y  5 

Total . . . . . ” 155  "lOO 

Second  Ak  Forte  Study 

Corresponding 
N  Percent  percent  SAF ' 

Poor  judgment  (miscalculation  of  wired,  etc)  .  14  17  32 

Incautious  planning  (includes  ndkanm)  . . .41  SI  2S 

Reaction  after  imposed  emergency .  S  10  17 

Poor  division  of  attention  . . 17  21  23 

Miscellaneous,  not  classifiable .  1  1  '  0 

Total  . .~M  *100  f  WO 


a  comparison  of  the  test  scores  of  pilots  who  later  had  accidents  or  were 
eliminated  from  training  with  scores  of  pilots  who  were  more  successful  in 
training  might  reveal  personality  differences  that  might  be  of  predictive 
value.  In  table  2.8  are  presented  the  mean  scores  for  pilots  with  aircraft 
accidents  and/or  who  were  eliminated  by  FEB  action  and  mean  scores  for 
pilots  more  successful  in  operational  training.  Except  for  a  larger  per¬ 
centage  of  doubtful  answers  among  the  failure  group,  none  of  the  differences 
between  the  two  groups  is  of  significance.  The  trait  where  the  difference 
most  nearly  approaches  significance  (8  percent  level  or  less)  is  Pt  or 
“Psychasthenia”  and  here  the  failure  group  shows  the  adverse  trait  even 
less  than  the  success  group,  Since,-the  lie  score  is  also  slightly  greater  for 
the  failure  group,  no  great  significance  can  be  attached  to  any  of  the  ob¬ 
served  differences.  ^ 

•  i 
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Of  perhaps  more  interest  is  the  generally  favorable  score  on  most  traits 
of  the  total  group.  The  main  exception  here  Is  the  poor  or  “abnormal” 
score  on  Ma,  Hypomania.  Evidently  the  fighter  pilot  differs  from  the 
norm  of  the  general  population  rather  markedly  in  this  trait.  This  coin* 
ddes  with  the  popular  view  of  the  ideal  fighter  pilot  as  slightly  manic  and 
over active. 

T UXS  t.lj—FSgkt  instructors’  tsU  fight  swrgttn/  exfUnntio*  fte  tit 
Sftdfc  itfdendes  fa  rt-ttthuUd  stmdtnU 
Town  ant  rones 

ExfUt&Un 

Numbtr  tf  timts 


Personality  tad  ch»'  icter  defects: 

Defects  not  directly  associated  with  flying: 

Emotionally  immature  . 3 

Emotionally  Unstable  . I 

Lade  of  dbdpBne  .  2 

Carelessness  . I 

Total  . “I 

Defects  directly  associated  with  flying: 

Fmr  . .  14 

Lack  of  confidence  .  7 

"Temperamentally  unsuited*  . . 6 

Nonaggresstve  . 4 

Psychiatric  conditions  .  3 

No  desire  to  learn  ....  3 

Tenseness .  2 

Dislike  for  acrobatics . . . I . .  2 

Total . "41 

Defects  fa  skill:  ** 

General  defects  (“Is A  of  apitude")  .  g 

Poor  Judgment  . 5 

Slow  reaction  time  .  j 

Slow  learning  rat* .  j 

Total  ...! . lo 


OUT  RIA  OF  PROFICIENCY 

The  types  of  missions  a  i  main  emphasis  of  training  have  been  described 
in  the  previous  section.  '•  ot  all  of  the  missions  or  all  of  the  training  ac¬ 
tivities  were  suitable  for  i  se  in  evaluating  pilot  proficiency.  Certain  mis¬ 
sions  -aid  activities  yielcti  relatively  more  useful  measures  than  others. 
Many  provided  no  inforr  i  tion  whatever  except  number  of  hours  of  flying 
accomplished.  In  the  fc  jwing  discussions  of  the  individual  criteria  an 
attempt  will  be  made  t<  evaluate  each  in  terms  of  certain  standards  of 
usefulness.  The  main  co  s  sderatiens  are:  tb  :  nature  of  the  distributions  of 
•cores  (dispersion  and  'ewness);  the  reliability  of  the  scores  (internal 
consistency) ;  the  capa<  t  y  to  discriminate  between  individuals  known  to 
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differ  In  proficiency;  the  extent  to  which  all  aspects  of  the  job  are  covered; 
the  objectivity  (susceptibility  to  personal  bias,  general  Impression  errors* 
etc.);  and  susceptibility  to  miscellaneous  and  special  sources  of  error* 
Finally,  at  the  cud  of  the  section  on  Criteria,  there  is  an  over-all  evaluation^ 
including  comparisons  between  various  different  criteria. 

Single  Criteria 

Fixed  Gunnery,  Bombing  and  Rocket  Firing 

1.  Description. — In  the  advanced  phase  or  latter  half  of  fighter  pilot 
training  at  the  operational  level,  the  principal  emphasis  was  upon  instruc¬ 
tion  in  gunnery,  bombing,  and  rocket  firing.  Minimum  requirements  wen 
the  firing  of  2,000  rounds  per  student  for  P-38,  P-40  and  P-47  students. 

Table  2 A. — Comparison  of  scores  on  the  Minnesota  mtdUpkadc  Inventory 
163  Pilots  hiving  aircraft  accidents  or  FEB  action 
804  Pilots  without  accidents  or  FEB  elimination 
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A  maximum  of  3,000  to  3,600  rounds  was  permitted.  Gun  camera  missions 
up  to  a  maximum  of  SO  percent  of  aerial  gunnery  training  time  were  per¬ 
mitted,  provided  the  minimum  rounds-fired  requirement  was  met 
Gunnery  training  missions  were  of  three  types:  camera,  air-to-air  firing, 
and  air-to-ground  firing.  Air-to-air  firing  was  done  at  low,  medium,  and 
high  altitudes.  The  target  was  towed  approximately  1,000  feet  behind  a 
TB-26  flying  straight  and  level  at  175  to  180  m.  p.  h.  Scores  on  high 
altitude  missions  were  usually  low  and  such  missions  were  seldom  scored, 
b<  mg  flown  for  familiarization  only.  The  data  below  on  air-to-air  firing 
were  from  low  and  medium  altitude  missions.  The  usual  target  was 
6  bv  30  feet  in  size  (180  sq.  ft.).  The  number  of  hits  on  the  target  was 
dr'ded  by  the  number  of  rounds  fired  to  provide  the  “gunnery  score”  (i.e^ 
.•jrcent  hits).  Because  of  shortages  of  materials,  targets  for  air-to-air  firing 
were  not  always  of  the  same  type  or  size,  although  attempts  were  made  to 
compensa!e  ior  this  variation  by  converting  the  percent  hits  obtained  to 
equivalent  scores  on  a  standard  target.  Whenever  an  atypical  or  frayed 
target  was  used,  a  corrected  hits  score  was  obtained  by  the  formula: 
Corrected  score  =  (180/actual  target  area)  X  (actual  hits).  Records  of 


703330 — 47 — 3 
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scorable  rounds  fired  tod  numbers  of  Vis  were  maintained  by  the  gunnery 
officers  or  by  record  clerks  is  the  training  sections. 

In  ground  gunnery  the  training  directives  specified  that  a  minimum  of 
1000  rounds  be  fired  for  record  at  ground  targets  36  square  feet  In  area. 
This  ground  gunnery  was  considered  a  "build  up  and  preliminary  for 
serial  gunnery  and  strafing."  Since  a  pilot  usually  obtained  quite  a  few 
hits  on  the  target,  it  gave  him  confidence  in  himsel  and  his  plane.  Bomb* 
ing  training  included  both  dive  and  skip  bombing  missions.  The  minimum 
requirements  in  skip  bombing  were  .2  bombs  dropped  singly  upon  a  vertical 
target  10  by  20  feet  In  dive  bombing  students  were  required  to  drop 
16  bombs  singly  upor  a  target  300  feet  In  diameter  for  P-38  aircraft  and 
100  feet  in  diameter  for  P-40  and  P-47  aircraft  The  bombing  was  usually 
scheduled  in  conjunction  with  other  missions  and  was  supposed  to  teach 
p>oper  approach  technique,  importance  of  correct  trim,  use  of  the  gun  sight, 
«md  in  dive  bombing  how  to  break  downward  at  the  same  point  as  the 
leader.  Rocket  firing  was  introduced  into  fighter  pilot  training  in  1945,  but 
no  data  on  rocket  proficiency  have  been  reported  by  the  research  units  In 
the  Continental  Air  Forces. 

2.  Disadvantages  as  a  criterion. — Use  of  gunnery  scores  as  student  pilot 
proficiency  data  encountered  a  number  of  characteristic  difficulties  which 
have  plagued  research  workers  in  this  field.  Among  these  were  the  follow¬ 
ing: 

a.  Training  procedures  and  requirements  were  in  process  of  being 
changed  almost  continually  during  the  fail,  winter,  and  spring  of  1944-45, 
rendering  not  comparable  the  data  obt  lined  on  successive  classes  of  student 
pilots. 

b.  Station  differences  in  recording  g/ ornery  scores,  in  scheduling  mi«f nn^ 
in  providing  incentives  and  in  instru \ional  procedures  led  also  to  lack  of 
comparability  of  score-,  from  station  to  station,  even  within  a  single  air 
fence. 

c.  The  number  of  srorable  mission!  (especially  for  air-to-air  gunnery) 

varied  widely  from  student  to  student  .ven  in  the  same  station  and  ilass. 
These  discrepancies  w  ire  attributable  bc>  to  differences  in  number  of  mis¬ 
sions  flown  and  to  such  factors  as  numb  ,  of  lost  targets,  gun  jams,  etc., 
which  determined  the  number  of  scoreabU  missions  out  of  those  actually 
flown.  \  ' 

d.  The  number  of  rounds  fired  varied  grutly  from  student  to  student 
both  on  smgle  mission;  and  for  the  entire  cour. •  of  training. 

e.  The  conversion  iormula  designed  to  coi  pensate  for  different  sized 
targets  fobably  did  not  yield  strictly  comparab.;  scores  in  all  cases. 

These  difficulties  led  to  extensive  differences  !:om  sample  to  sample  of 
studeiv  pilots  (by  station  and  class)  and  ob  .ously  acted  as  spurious 
facto; »  affecting  the  reliability  of  the  gunnery  set  \  s.  A  serious  implication 
of  tl.  ;se  differences  was  the  necessity  of  calculatin,  'eliabQlties  and  stanine 
vaK  ’-itJes  separately  for  each  sample  of  pilots  obtab  \  \.  Furthermore,  there 
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was  introduced  (he  problem  of  the  best  method  to  employ  In  combining  the 
various  small  samples  in  order  to  achieve  statistics  based  on  a  sufficient 
cumber  of  cases  to  warrant  safe  generalizatkssa. 

3.  Factors  influencing  gunnery  scene:. — Aviation  psychologists  in  the 

;  First  Air  Force  made  a  systematic  attempt  to  investigate  the  factors  deter* 
mining  the  gunnery  scores  of  student  pilots.  This  personnel  spent  sever  d 
weeks  at  advanced  training  stations  of  the  I  Fighter  Command  observing 
firsthand  the  gunnery  training  process.  The  investigation  revealed  many 
factors  affecting  gunnery  scores,  roughly  falling  into  seven  categories  as 

j!  follows: 

(  a.  Training  methods . — proper  briefing  ard  critique,  number  of  camera 
missions  before  start  of  firing,  number  and  type  of  missions  Sown  per  day, 
time  elapsing  between  gunnery-type  missions,  and  time  elapsing  between 
a  gunnery  mission  and  its  assessment 

,  b.  Motivation  aud  interest. — Several  techniques  were  employed;  knowl¬ 
edge  of  success  and  comparative  standing  in  the  group,  rewards  in  the  fora 
of  cross-country  flights  and  early  leaves  of  absence,  penalties  in  being  held 
back  for  failure  to  qualify  in  gunnery,  etc.  Extensive  differences  were  found 
among  stations  in  the  use  of  incentives.  Those  stations  emphasizing  motiva¬ 
tion  the  most,  consistently  reported  the  highest  gunnery  scores. 

c.  Instructors. — Positive  correlation  (e.g.,  coefficient  of  0.67  on  1  sample 
of  33  instructors  and  60  students,  based  on  14  or  more  instructor  missions) 
were  found  between  total  percent  hits  of  student  pilots  and  the  average 
percent  hits  of  individual  instructors.  It  was  further  found  that  for  class 
after  class,  student  pilots  at  those  stations  where  instructors’  gunnery  scores 

(  were  low  did  less  well  than  students  at  stations  where  instructors’  gunnery 
scores  were  higher.  The  latter  of  course  may  or  may  not  have  been  the 
result  of  a  tendency  for  students  and  their  instructors  to  have  similar  gun¬ 
nery  skill.  Station  differences  in  scoring,  gunnery  procedures,  etc.,  may 
have  influenced  the  scores  of  both  instructors  and  students. 

d.  Mechanical  factors. — Principal  factors  include  harmonization  of  the 
guns,  condition  of  the  gun  mounts,  malfunctions,  size  of  target  and  conver¬ 
sion  factor  for  targets  of  different  size,  individual  aircraft  characteristfci 
and  ?Lot>away  targets.  Of  these,  harmonization  and  size  of  the  target  were 
gererally  considered  to  be  the  most  important 

.  e.  Weather. — Wind  and  visibility  are  the  weather  components  most  af¬ 
fecting  gunnery  scores.  Both  day-to-day  and  seasonal  variations  probably 
influence  gunnery  performance.  Quantification  of  weather  factors  to  provide 
for  statistical  analysis  is  difficult 

f.  Scoring  procedure. — Variable  factors  in  this  category  are  the  follow¬ 
ing:  identification  of  hits  on  the  target,  conversion  factor  to  equate  for 
different  sizes  of  targets,  errors  in  recording  hits  and  computing  percent¬ 
ages,  and  errors  in  counting  the  numbur  of  unfired  rounds  at  the  end  of  the 
mission, 

t 

g.  Flying  experience. — Data  snmm  aized  below  indicate  dearly  that 
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tan|  jtgd'sl  peJcCs  (Lose  with  sort  experience  («4,  farmer  iaatnctmi) 
cmsBStcrjZy  si oca  mate  ac  untriy  thaa  do  anrfy  nUd  pte. 

It  ns  csodand  that  m  adtikkm  to  tie  Jtfnam  factor  at  pnfidoxy, 
tie  (actffs  of  ootintm,  t&dhms  ot  iestractioc,  weather  bJ  scaring 
pnodue  (ia  air-to-air  peacj  ooljr)  see  tie  mast  import  nX  Motes  of 
mdhridcal  diieeacs  ■  tie  scores  attorned 

4.  Dutriimiwm  »f  scare s. — The  boss  aad  standard  dtnatkss  of  £■*- 
aery  scores  foe  different  aayfes  of  stadeot  pilots  varied  as  asd  wit  hi*  a 
siegfe  air  force  as  betnu  docest  air  forces.  For  example,  for  10  chars 
at  oca  of  three  stations  ia  tie  fuzz  Ak  Force  tie  raeaa  air-to-air  gnaexy 
scores  varied  freer  2.07  to  12.55.  The  standard  deviation  for  these  data 
varied  free:  1.44  to  6.77.  The  oesnber  of  pilots  per  dass  varied  fret.  16 
to  S3,  .  Jt  median  size  being  40.  Sanslar  data  from  several  ckssa  at  each 
of  4  stauos  in  the  Fourth  Air  Farce  gave  mean  air-to-air  gaonesy  saxes 
ranging  frocn  1.96  to  8.74  and  d*«  size  varied  from  27  to  131  with  a 
median  of  70.  Standard  deviations  ranged  from  1.40  to  4.11.  Cdrrespood- 
wz  data  from  t!e  Second  Air  Force  may  £>'  food  in  table  2.11  presenting 
reliability  coefbcients  in  the  next  section  of  this  chapter. 

Air-to-groaisd  gunnery  scores  gave  shrilar  results  with  means  varying 
from  6.71  to  21.55  in  the  First  Air  Force  and  4.63  to  21.03  sc  the  Fourth 
Air  Force.  Conespooding  variations  is  standard  deviations  were  231  to 
9.63  and  3.04  to  11.94  in  the  First  and  Fourth  Air  Forces  respectively. 
Data  on  dive  bombing  were  available  only  in  the  Fourth  Air  Force  where 
mean  scores  ranged  from  22.56  to  82.96  with  standard  deviations  iron 
3X3  to  28.74. 

In  the  jjdsj  of  194$,  the  First  and  Seeaod  Air  Forces  began  to  place 
much  greater  esghasis  spaa  gunnery  and  bombing  scares,  setting  up  mini¬ 
mum  qualifying  scores  and  stressing  improved  methods  cf  training.  The 
consequent  improvement  in  gunnery  scores,  especially  in  air-to-air  gunnery, 
is  strikingly  demonstrated  ia  izbk  2.1 1  for  data  from  the  Secood  Air  Forces 
The  dela  from  the  First  Air  Force  sly  *vc  z  x.  ilar  trend  since  the  highest 
mea*j  scores  were  obtained  with  the  most  repeat  classes  at  each  station. 

Aviation  psychologists  in  the  Fourth  Air  Force  made  a  study  erf  the 
shapes  of  the  distributions  of  scores  of  P-38  pilots  in  air-to-air  and  air-to- 
ground  gunnery  and  in  dive  and  skip  bombing.  Raw  scores  for  each  station 
and  class  were  transformed  into  standard  scores  with  a  mean  of  50  and  a 
sigma  of  1C.  The  data  are  presented  in  table  2  9.  Frequency  distributions 
o i  air  and  ground  gunnery  scores  obtained  in  the  First  and  Second  Air 
Forces  were  essentially  similar  to  those  shown  in  the  table.  The  distribu¬ 
tions  of  scores  in  air-to-a-r  gunnery,  (and  also  in  air-to-ground  gunnery, 
but  to  a  lesser  extent) ,  are  markedly  skewed,  since  most  of  the  pilots  made 
scores  near  the  poor  end  of  the  range  of  scores.  The  reason  this  particular 
type  of  distribution  was  obtained  may  lie  partly  in  the  fact  that  pilots 
could  not  get  less  than  zero  hits  and  partly  in  the  fact  that  an  attempt  was 
made  in  training  to  make  each  pilot  attain  at  least  a  minimum  level  of 
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performance.  Datribntfoos  d  scores  affected  by  i  rut-off  point  or  Bail 
«f  performance  are  Ekdy  to  shew  a  piling  op  of  frequencies  near  sack  a 
point  or  bffBtxog  score.  la  contrast  to  the  pasoy  scores  tkee  far  in 
and  skip  bombing  were  fairly  normally  datrftuted,  those  for  skip  bombing, 
butter,  being  slightly  skewed  in  the  opposite  direction  to  giamury  secret. 
These  permitted  a  rdatrreiy  continuous  distribution  of  amount  of  error, 
since  few  pilots  approached  zero  scores.  The  differences  in  shape  of  these 
distributions  may  be  an  artifact  of  the  scoring  system. 

5.  RdicbZilics. — ReSabsHty  studies  on  fixed  gunnery  scores  have  been 
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reported  from  the  First,  Second,  and  Fourth  Air  Forces.  The  First  Air 
Force  reported  two  studies  differing  in  meLr'xi.  Both  studies  involved  the 
correlation  of  scores  fin  odd  and  even  missioi  s.  The  first  study  was  cased 
on  the  same  nr'nber  of  missions  for  all  pBo-s  in  a  given  sample,  which 
meant  throwing  a  way  scores  on  later  missions  for  those  men  wbese  records 
showed  a  larger  number  of  scoreable  missions.  Since  many  pilots  bad  only 
four  to  six  scored  missions,  only  this  small  number  of  missions  was  utilized 
in  the  study.  Hence  the  size  cf  the  correlation  coefficients  to  be  expected 
was  necessarily  limited.  The  results  of  this  study  are  summarized  in  table 
2.10. 

In  the  second  reliability  study  from  the  First  Air  F  rce  an  attempt  was 
made  to  utilize  all  oi  the  data  available,  including  the  'ores  on  laser  mis 
sons.  The  students  within  a  single  station  w.re  combi.  *d  and  regrouped 
on  the  basis  of  the  number  of  scoreable  missicas  on  their  cords.  The  odd 
and  even  mission  scores  were  then  oo>  relatec  for  each  of  .^ese  subgroups 
(i.e.,  four-mission  group,  six-mission  group,  ight-mission  group,  etc.)  in- 
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dependent)?,  the  resulting  correUtioos  bdnf  Inter  combined  by  Filbert  #. 
The  rendu  for  three  training  stations  are  summarized  in  table  1.10. 

For  the  data  obtained  b  tbe  Secood  Air  Force,  tbe  eomUtfoes  between 
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gunnery  scores  for  odd  ind  even  missions  (based  on  14  mission*;)  are  given 
in  table  2.11. 

Tables  2.12  and  2.13  summarize  tbe  reliability  studies  reported  from  the 
Fourth  Air  Force  for  gunnery  and  bombing  scores.  The  coeffidenU  re* 
ported  are  based  on  tbe  correlation  between  scores  made  on  odd  and  even 
missions,  all  sccreable  missions  being  included  in  tbe  compuUtiona.  The 
r’s  for  the  individual  samples  in  these  tables  have  been  adjusted  by  tbe 
Spearman-Brown  formula.  Tbe  weighted  averages  of  tbe  corrected  r'%  given 
In  tbe  tsbles  are  thus  comparable  to  tbe  estimated  total  reliabilities  re¬ 
ported  from  tbe  First  and  Second  Air  Forces.  Separate  data  are  given  for 
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P-JS  And  P-61  pQols;  and  there  was  a  marked  difference  la  the  rdlahUlttoa 
obtained  for  the  two  types  of  aircraft  A  possible  explanation  of  the  rda- 
lively  low  degree  of  reliability  found  fee  the  air-to-air  gunnery  scores  of 
P-48  pilots  is  the  fact  that  P-38  pilots  did  their  firing  la  several  different 

Tab*  IMr-RtOobdiy  coefficients  «/  fw nncry  scorn  for  P-47  plots 
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Tabic  2.12. — Reliability  coefficients  of  tannery  and  bambini  scores  for  P-3S  plots 
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models  of  the  aircraft  Since  It  was  not  possible  to  control  this  factor  la 
the  computations  of  reliability,  the  obtained  coefficients  may  have  been 
somewhat  lowered  thereby. 

Table  2.14  contains  a  summary  of  the  average  reliability  coefficients  for 
air-to-air  gunnery  reported  by  the  First,  Second  and  Fourth  Air  Forces. 

6.  Evaluation. — One  important  consideration  in  estimating  the  adequacy 
of  a  criterion  of  proficiency  is  the  extent  to  which  it  reflects  known  dif- 


Tsau  2.13. — Reliability  cotfidenls  of  gmmery  KOttt  for  P-61  pBott 
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ferences  in  proficiency.  A  study  of  this  type  was  accomplished  in  the  First 
Air  Force  where  a  comparison  was  made  of  the  gunnery  scores  of  pilots 
with  varying  degrees  of  experience.  The  hypothesis  was  that  if  gunnery 
scores  were  a  valid  criterion  of  fighter  pilot  proficiency,  the  more  experi¬ 
enced  pilots,  particularly  those  with  P-47  experience,  should  higher 
average  scores.  The  study  was  based  on  the  gunnery  records  of  pilots  com¬ 
pleting  training  during  the  period  from  January  through  April  1945  in  the 
I  Fighter  Command.  Four  levels  of  experience  were  studied:  pilots  recently 
graduated  from  the  AAF  Training  Command;  pilots  who  had  previously 


Tasl*  2.14. — Average  reliability  cot  fi  dents  for  air-to-air  tannery  scorn 
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been  instructors  in  the  AAF  Training  Command;  pilots  who  had  previously 
been  P-47  instructors  in  basic  training  at  stations  in  the  I  Fighter  Com¬ 
mand;  and  pilots  who  had  previously  been  P-47  instructors  at  advanced 
training  stations  of  that  Command.  The  average  scores  for  these  four 
groups  are  shown  in  table  2.15, 

The  average  scores  for  aerial  gunnery  indicate  there  was  a  consistent 
positive  correspondence  between  level  of  experience  and  excellence  of  per¬ 
formance.  This  relation  is  not  quite  so  clear  fcr  ground  gunnery  scores, 
but  in  all  cases  advanced  instructors  had  the  highest  scores  and  new  trainee 
pilots  had  the  lowest.  Since  the  number  of  P-47  instructors  (from  both 
basic  and  advanced  training  stations)  was  so  small,  no  attempt  was  made 
to  calculate  critical  ratios  between  their  average  scores  and  those  of  pilots 
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is  the  other  categories  of  experience.  However,  scores  were  available  for 
larger  numbers  of  former  AAF  Training  Command  instructors  and  newly 
rated  pQots  and  the  statistical  significance  of  differences  between  the  aver* 
age  scores  for  these  categories  is  given  in  table  2.16.  In  the  Second  Air 
Force,  the  correlation  between  average  gunnery  scores  of  P-40  pSots  and 
number  of  hours  of  previous  P-40  flying  time  was  found  to  be  0.68  for  cne 
class  of  35  trainees. 

The  differences  is  First  Air  Force  data  favoring  the  experienced  pilots 

Tabu  2.1  S. — A  comparison  of  the  ginnery  scores  of  P-47  pdou  of 
four  levels  of  experience 
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and  the  correlation  between  gunnery  score  and  hours  of  experience  in  the 
Second  Air  Force  data  appear  to  warrant  the  conclusion  that  gunnery  scores 
do  differentiate  between  the  performance  of  experts  (e.g.,  former  instructors 
with  many  hours  of  flying  time)  and  that  of  novices  (e.g.,  recently  rated 
pilots  with  relatively  little  flying  time). 

Although  some  of  the  reliability  estimates  appearing  in  the  tables  la 
this  section  are  of  somewhat  lower  magnitude  than  that  generally  desired 
for  validation  studies,  the  fact  that  the  r’s  on  the  individual  small  samples 
are  so  consistently  positive  is  indicative  of  a  degree  of  reliability  sufficient 
tv  warrant  the  use  of  these  criteria  as  measures  of  individual  differences  in 
pilot  proficiency.  As  was  pointed  out  earlier,  the  necessarily  small  numbers 
'of  missions  upon  which  some  of  the  studies  were  based,  imposed  some 
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Balts  oo  the  size  of  the  reliability  coefficients  which  could  be  expected.  Aad 
there  b  also  the  known  source  of  error  In  the  modd  of  plane  used  la  the 
case  of  the  lowest  reliability  reported,  that  of  0.31  for  the  P-31  pDota. 

Ia  summary,  it  should  be  pointed  out:  a.  Gunnery,  bombing  and  rocket- 
firing  scores  are  relatively  objective  and  are  little  affected  by  personal  Was 
of  any  sort  Such  errors  as  were  noted  could  probably  be  controlled  by 
minor  changes  in  training  procedures.  Many  early  sources  of  error  were 
in  process  of  being  overcome  at  the  dose  of  hostilities,  b.  These  scores 
have  a  logical  validity  because  of  similarity  to  the  ultimate  combat  objec- 
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three,  c.  They  reflect  known  differences  in  proficiency,  d.  And  finally,  they 
have  a  moderate  degree  of  reliability.  Gunnery  scores  might  thus  be  ex¬ 
pected  to  provide  a  useful  criterion  for  validation  of  selection  bate  and 
>  procedure*. 

SAsrt  Scares 

1.  Duvription. — A  cumber  of  instructors  in  the  Second  Air  Force  ex¬ 
pressed  a  belief  that  there  was  a  high  degree  of  correlation  between  sheet 
scores  and  scores  in  serial  gunnery.  Since  the  former  were  relatively  easily 
obtained  at  the  stations  involved,  it  w as  dedded  to  make  an  exploratory 
study.  In  general  each  fighter  pilot  was  requ'-ed  to  fire  «t  least  400  rounds 
of  sheet  during  operation  training.  Scores  were  recorded  in  terms  of  per¬ 
cent  bits  obtained  in  sets  of  25  rounds  fired.  At  some  stations  scores  of  aP 
sets  of  25  rounds  fired  were  recorded.  At  other  stations  records  were  main¬ 
tained  only  for  certain  sets  of  25  rounds  spaced  at  about  equal  intervals 
throughout  the  400  rounds  fired. 

2.  Distribution  of  sems  and  rtliobUMtt—  Data  on  sheet  scores  wen 


available  for  two  classes  at  AAF  Pocatello  and  one  class  at  Peterson  Field. 
These  107  fighter  pilots  had  a  mean  score  of  53  with  a  standard  deviation 
of  9.6.  The  weighted  average  of  the  separate  correlations  between  average 
odd  and  average  even  scores  for  the  different  classes  was  M  giving  an  esti¬ 
mated  reliability  of  .50  for  the  average  total  score. 

3.  Evaluation. — Although  there  was  very  little  logical  reason  to  suppoat 
that  proficiency  in  sheet  shooting  would  be  much  related  to  over-all  fighter 
pQot  proficiency,  the  fact  that  this  activity  was  included  in  the  training 
requirements  was  felt  to  justify  at  least  an  exploratory  study.  For  the 
small  number  of  pilots  studied,  these  scores  are  seen  to  have  some  low  de¬ 
gree  of  reliability.  The  extent  to  which  they  are  correlated  with  gunnery 
scores  should  give  an  indication  whether  or  not  the  tash  is  in  any  way  re¬ 
lated  to  gunnery  performance.  The  average  correlation  between  sheet  and 
gunnery  scores  was  found  to  be  0.28  for  96  pilots  of  three  classes.  This 
coefficient  is  rathe:  high  considering  the  unreliability  of  both  types  of 
scores.  The  small  number  of  cases  makes  definite  conclusions  impossible. 

Mission  Grades  and  Comments 

1.  Description. — At  some  training  stations  in  all  three  air  forces  respon¬ 
sible  for  training  fighter  pilots,  it  was  customary  to  employ  mission  cards 
on  which  the  instructors  evaluated  missions  after  their  completion.  On 
these  cards  the  instructors  usually  assigned  a  grade  and  sometimes  added 
comments  on  specific  aspects  of  the  student’s  performance.  Grades  were 
assigned  for  the  most  part  according  to  the  usual  five  point  military  rating 
scale  ranging  from  "superior”  to  “unsatisfactory.”  At  some  station  in  the 
Fourth  Air  Force  numerical  percentage  grades  were  assigned.  The  accom¬ 
panying  comments  were  sometimes  favorable  and  sometimes  unfavorable. 
The  specific  procedures  used  in  grading,  type  of  mission  card  employed 
and  number  of  missions  graded  varied  greatly  from  station  to  station  and 
from  one  air  force  to  another.  In  the  First  Air  Force  there  were  eight  types 
of  cards  in  use,  one  for  each  type  of  mission  flown  at  the  basic  training 
stations  (transition,  formation,  navigation,  instrument  flying,  acrobatics, 
combat  maneuvers,  night  flying  and  cross-country).  In  the  Second  and 
Fourth  Air  Forces  a  single  general  mission  card  was  usually  used.  During 
the  course  of  instruction,  a  student  pilot  was  likely  to  be  graded  several 
times  by  each  of  several  different  instructors.  In  the  First  Air  Force,  grad¬ 
ing  was  done  by  from  6  to  10  different  instructors. 

2.  Distribution  of  Different  Mission  Card  Scores. — Detailed  studies  of 
data  obtained  from  mission  cards  were  carried  out  only  in  the  First  and 
Fourth  Air  Forces.  No  mission  grades  or  comments  in  the  Second  Air  Force 
seemed  sufficiently  promising  to  warrant  such  analyses  as  were  made  in  the 
other  air  forces.  The  frequencies  and  percents  of  different  grades  and  cate¬ 
gories  of  comments  found  in  two  independent  studies  of  mission  cards  In 
'•he  First  Air  Force  are  shown  in  table  2.17.  this  particular  analysis, 
neutral  remarks  were  not  counted. 
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Xa  order  to  carry  out  further  statistical  analyses,  research  personnel  in  the 
First  Air  Force  converted  both  grades  and  comments  into  quantitative 
scores.  Weights  for  the  various  mission  grades  were  obtained  by  assuming 
a  normal  distribution  of  pilot  aptitude  and  then  finding  the  distance  from 
the  mean  in  a  normal  curve  for  the  actual  percent  receiving  each  rating. 

Tana  2. 17  ^-Distribution  of  instructors'  grades  and  comments  om 
Individual  mission  cards 
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These  statistically  derived  weights  were  multiplied  by  a  constant  to  remove 
decimal  points  and  seven  was  added  to  each  one  to  obviate  working  with 
negative  scores.  The  final  values  employed  were:  superior  =  11;  excel¬ 
lent  =  7;  very  satisfactory  =  4;  satisfactory  =  2;  unsatisfactory  =  0. 
For  the  comments,  favorable  ones  were  given  a  value  of  8;  minor  faults 
were  given  4;  and  major  faults,  0.  Distribution  statistics  of  the  resulting 
grade-scores  and  comment-scores  for  three  random  samples  of  data  ere 
shown  in  table  2.13. 


Tabu  2.18. — Distribution  statistics  of  proficiency  scons  derived  ‘rom 
mission  card  grades  and  comments 
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In  table  2.19  are  given  the  distribution  statistics  for  scores  derived  from 
mission  card  grades  and  comments  in  the  Fourth  Air  Force.  The  numerical 
values  assigned  grades  and  comments  in  .he  Fourth  Air  Force  differed  from 
those  used  in  the  First  Air  Force  studies. 

The  grade  scores  yielding  the  data  in  >  le  table  were  the  raw  numerical 
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grades  given  by  the  Instructors.  Mission  comments  were  converted  into 
numerical  values  by  computing  an  “adversity  score”  for  each  pilot  This 
score  was  100  times  the  ratio  of  the  number  of  missions  adversely  cc*a- 
mented  upon  to  the  total  number  of  missions  graded,  one  grade  being  gives 
for  each  mission  flown. 


Tabu  2.19. — Means  and  standard  deviations  of  grade  scares  and  comment 
scores  from  mission  cords 

FOURTH  AIR  FORCE 


*  . 

Grade  scores 

N 

Adrrralty  tannest  icotm 

Mesa 

S.  D. 

Meam 

s.n. 

•1.94 

•0.44 

2.55 

1.3* 

JO . 

21.99 

21.65 

(.99 

.  Il.tt 

99 . 

lifl  ■ 

3.  Reliabilities. — Grade  scores  and  comment  scores  from  odd  and  even 
numbered  missions  were  correlated  to  obtain  some  estimate  of  the  re¬ 
liability  of  such  scores.  The  reliability  coefficients  so  obtained  in  the  First 
and  Fourth  Air  Forces  are  shown  in  table  2.20.  The  coefficients  reported 
are  surprisingly  high  in  view  of  the  following  conditions:  a.  the  total  num¬ 
ber  of  missions  flown  varied  from  student  to  student ;  b.  missions  were  not 
flown  in  the  same  order  by  all  students;  c.  the  number  of  cards  for  any 
single  type  of  mission  was  small;  d.  missions  were  flown  with  several  dif¬ 
ferent  instructors;  e.  instructors  varied  widely  in  the  number  and  type  of 
comments  recorded  on  the  card;  and  f.  instructors  varied  greatly  in  the 
relative  degrees  of  importance  they  assigned  to  particular  aspects  of  flying 
performance.  It  might  be  pointed  out  that  the  somewhat  higher  reliability 


Tabu  2.20 .—Reliability  coefficients  of  mission  card  grade  scores  and  comment  scores 
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obtained  (or  the  mission  grades  as  compared  with  comment  scores  might  be 
a  reflection  of  a  "halo  effect”  In  the  assignment  of  grades. 

4.  Interrelation  of  grades  and  comments. — The  relation  between  in¬ 
structors’  grades  and  their  comments  is  shown  in  table  2.21  where  the 
derived  scores  for  grades  and  comments  were  correlated  for  several  samples 
of  data. 

Tabu  2Jl^-CerrelcUotu  betv ten  grade  scores  end  comment  scorn  from  mission  cents 
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5.  Evaluation— The  First  Air  Force  Unit  made  a  comparison  between 
experienced  (former  Training  Command  instructors)  and  inexperienced 
(recent  graduates  from  the  Training  Command  Flying  Schools)  pilots  on 
scores  derived  from  the  mission  card  comments.  The  results  appear  in 
table  2.22.  The  difference  in  favor  of  the  former  instructors  Is  evidence  of 
the  capacity  of  the  mission  card  comments  to  differentiate  experienced 
pilots  from  novices  in  the  P-47  airplane. 

The  distributions  of  comment  scores  and  the  estimates  of  their  reliability 
show  that  they  should  be  adequate  for  use  as  criterion  data  of  fighter-pilot 

Tabu  222  .—Differences  between  former  AAF  Training  Command  instructors 
and  newly-rated  pitots  in  mission  comment  scone 
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proficiency.  While  statistically  the  mission  grade-scores  appear  to  b*  as 
satisfactory  criterion  measures  as  those  derived  from  the  mission  comments, 
the  former  are  subject  to  the  usual  errors  which  attend  general,  over-aK 
assessments  of  individual  proficiency.  The  mission  card  connunlt  hsrt  an 
advantage  in  that  they  are  likely  to  be  based  on  concrete  hc'&nccs  ot  good 
and  poor  flying.  Both  grade  and  comment  scores  have  the  following  ad¬ 
vantages  as  criteria  of  proficiency: 

a.  They  report  the  judgments  and  assessments  of  repeated  flighty  hence 
in  the  aggregate  cover  the  entire  course  of  training. 

b.  They  represent  a  combination  of  relatively  independent  assessrueaX} 
of  several  instructor*. 

c  Being  recorded  immediately  2ftcr  the  completion  of  the  mission,  the 
comments  are  relatively  free  from  errors  of  memory. 

6.  Development  of  experimental  mission  cards.— Both  the  First  and 
Fourth  Air  Force  Units  experimented  with  mission  cards  of  their  own  con¬ 
struction  designed  for  future  introduction  into  all  training  stations  as  devices 
for  obtaining  proficiency  data  on  fighter  pilots.  Research  personnel  in  the 
First  Air  Force  devised  two  tentative  types  o?  mission  cards  (see  appendix 
B.l  and  B.2)  and  tried  them  out  at  Richmond  Army  Air  Base,  then  train¬ 
ing  commitment  pilots  who  had  just  completed  operational  training  in  P-O 
airplanes.  The  first  card  followed  closely  that  already  in  use  at  one  of  the  - 
basic  training  stations  in  the  First  Air  Force.  Ten  aspects  of  flying  or  gun¬ 
nery  were  listed  and  there  was  left  to  the  individual  instructor  the  wording 
and  details  of  the  comments  asked  for  in  instances  of  particularly  “good”  » 
or  “weak”  flying.  The  second  card  was  of  the  check-list  type  and  contained 
19  items  to  be  checked  by  the  instructor  where  the  student  had  manifested 
a  weakness  or  an  outstandingly  good  performance  on  that  aspect  of  the 
flight.  The  cards  were  purposely  made  brief  and  undetailed  since  most  of 
the  instructors  interviewed  at  several  stations  were  agreed  that  a  long,  de¬ 
tailed  card  would  be  so  time-consuming  in  use  that  it  would  lessen  the  ef-  - 
fectiveness  of  the  device  for  obtaining  proficiency  data.  Experimental  use 
of  the  two  cards  was  curtailed  by  the  sudden  closing  of  the  Richmond  Army 
Air  Base,  followed  shortly  thereafter  by  the  end  of  the  war.  Opinion  of 
instructors  was  about  evenly  divided  as  to  the  relative  value  of  the  two 
cards.  Statistics  on  use  of  each  of  the  two  cards  for  a  brief  period  were  as 
shown  in  table  2.23.  The  percentage  of  items  checked  and  numbers  of 
comments  made  are  not  in  entire  accord  nor  strictly  comparable  because 
some  of  the  items  on  the  cards  apply  only  to  particular  types  of  mission*. 
On  the  basis  of  the  above  data,  it  is  not  possible  to  determine  which  is  the 
more  suitable  of  the  two  types  of  card. 

The  Fourth  Air  Force  Unit  constructed  a  mission  record  form  which 
was  considerably  more  detailed  than  the  cards  described  above.  The  check¬ 
list  method  was  followed  on  this  form.  No  data  have  been  reported  from 
actual  use  of  this  card  at  training  stations. 
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s  Nifty  Is  peaetke,  then*  were  extensive  individual  dSeresoes  (betwers 
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observers  at  a  given  station  asd  from  one  station  to  anotht-1  is  the  foB* 
ness  and  accuracy  of  the  records.  This  rendered  ve*v  difficult  a:>*»  compari¬ 
sons  among  different  stations  or  different  comr.  ;mt  !fs  of  pilo^..  Since 
different  officers  were  posted  in  the  tower  or  control  units  from  day  to  day, 
the  resulting  record  of  errors  and  violations,  while  indicative  of  com -non 
faults  in  basic  flying  technique,  is  probably  somewhat  unreliable  as  a  source 
of  criterion  data. 

2.  Distribution  statistics. — The  number  of  errors  recorded  by  mobile 
control  unit  operators  was  obtained  for  9,  3  and  3  classes  respu’ively  at 
Millville  AAF  (1AF,  basic  training),  Andrews  Field  (1AF,  advances  train¬ 
ing)  and  Strother  Field  (2AF,  all  training).  Each  class  included  fron.  25 
to  80  pilots,  the  median  size  being  35.  The  average  number  of  errors  it 
landing  recorded  per  class  varied  from  1.73  to  6.86  with  standard  devia¬ 
tions  cf  ,rom  1.56  to  5.17.  For  pilots  in  the  3  classes  at  Strother  Field  the 
percent  of  landings  on  which  errors  were  noted  ranged  from  0  for  som-i 
pilots  to  80  percent  for  1  pilot,  tbe  median  being  30  percent.  Six  pilots 
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xreraged  cm  tbs  coc  error  for  each  zsde.  Seitcitta  bd  M 

proo  recorded.  The  nrati«  free  pEbci  to  p&«  ixsi  frees  dta  to  dsa 
is  striking.  It  setss  (jasstfal  rbtbr  tbe  j£ocs  is  ier  dsf- 

fa  a  average  peo6deaqr  *o  tbe  cr^  biiri*:  by  these  figures,  Prob- 
jtgv  rniCT  saccotrotkd  soerces  of  error  ire  pceerst  ia  pjdj  data 
3.  JteOsbsSiia. — Tie  owt  cCe^utSe  r^r^J  of  tsisudej  rrttrbdity 
aosrts  as  tbe  data  described  assure  -wools  be  to  reVr^at*  tbt:  total 
ggriber  of  errors  for  a3  the  cod  eiaascs  with  these  for  all  tbe  nta  nm- 
sacas.  This  was  cot  pesshre  »;tb  tbe  type  of  records  available.  For  a 
sarnie  of  !00  p3 ots,  research  persecute!  c:  tbe  Firs*  Air  Focce  cocpated  tbe 
oontizLke  between  tbe  number  cf  nxbik  icotroc  szat  errors  recorded 
daring  tbe  bask  asd  2dvaaced  phases  c:  trarrmg.  A  prodact-rrerseoi  t 
J  0-23  (aacocrfrted)  was  obtained.  ind;v>2:sj  differetxes  m  rat*  of  ca- 
ocovesaest  arid  station  differences  of  ib  sorts  v *>bi  prebabiy  greatly  reduce 
the  size  of  coefficient  to  be  expected. 
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4.  Evaluation. — A  comparison  of  experienced  {former  Training  Cook 
manri  Instructors)  and  inexperienced  ( recent  graduates  from  Training 
Command  Flying  Schools)  pilots,  made  In  the  First  .Air  Force,  yielded  tbe 
results  shown  in  table  2.24.  The  differences  shown  in  the  table  are  small 
for  some  commitments,  but  the  inexperienced  pilots  consistently  showed 
greater  numbers  of  errors.  Since  the  identity  oi  the  pQot  against  whom 
errors  were  recorded  was  not  known  by  the  personnel  in  the  amts,  the 
above  differences  may  be  said  to  indicate  some  validity  cf  the  mobile  con¬ 
trol  unit  records  as  criterion  data. 

Perhaps  the  most  serious  criticism  of  reports  of  mobile  coDtroi  umts  as 
proficiency  measures  is  the  common  belief  that  beyond  a  minimum  level  of 
proficiency,  performance  on  landings  and  take-ons  is  relatively  unimpor¬ 
tant  in  combat  flying.  Although  accepted  by  many,  this  belief  is  not  sup¬ 
ported  by  data  on  accidents  which  shuw  that  ability  to  land  and  take  off 
safely  is  extremely  important  in  combat  training.  In  conclusion,  it  would 
be  expected  that  if  standard  recording  prxedures  were  followed  by  all 
mobile  control  unit  or  tower  operators  and  vucb  were  enforced  at  all  train¬ 
ing  statiovs,  the  records  of  specific  insta  ces  of  faulty  taxiing,  take-off, 
traffic  pattern  flying,  and  landing  would  <rtie  tisc-iul  proficiency  data  on 
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fighter  pB Ms.  However,  this  type  o 1 6ta  «mH  sot  bo  salbfacteey  If  wd 
«s  the  sole  criteria*  of  fijjbitr  pSot  pnfcksqr. 


I.  Fraud  rating  scales.  a.  Description . — After  trial  of  a  pR&daaiy 
rating  scale  of  five  item  at  four  training  stations  is  ibe  fan  of  1944,  revised 
eating  scales  for  both  the  basic  and  advanced  phases  of  training  were  em¬ 
ployed  in  the  First  Air  Force.  Instructors  rated  each  of  the  stadeats  on 
each  rust  of  the  scale  at  the  coaduao*  of  training  Flight  commanders 
were  requester  to  cooler  with  their  instructors  in  arming  at  a  final  profi¬ 
ciency  rating  for  a  student  so  that  this  rating  would  represent  the  pooled 
judgment  of  all  instructors  who  had  flown  with  him.  Each  item  was  ra«ed 
oq  ?  nve-pcint  sc  -  {5  —  superior,  1  =  mtnimnm  satisfactory).  The 
s  co  the  forte  used  in  bask  training  statiocs  (sez  appendix  B  J)  fel 
into  two  categories,  15  items  relating  to  /lying  technique,  and  7  items  re¬ 
lating  to  persendity  traits  deemed  important  in  fighter  pilots.  The  rating 
<r»V  used  in  advanced  training  stations  (see  appendix  B.4)  had  three  parts: 
8  ifetrx  cn  flying  f'ofcUxcy;  7  hems  on  gunnery  tedadque;  and  7  items  aw 
personality  traits. 

b.  Distributions  cf  ratings  obtained. — Ratings  on  the  individual  hems  of 
the  yr»Vt  were  summed  up  to  provide  a  total  rating  score;  sub- total  scores 
were  also  computed  oa  each  section  of  the  rating  scale  (see  above).  The 
hem  counts  and  distribution  statistics  obtained  indicated  a  slight  tendency 
for  the  ratings  to  be  concentrated  at  the  high  end  of  the  scale  and  to  dus¬ 
ter  about  the  points  3  and  4.  However,  opinions  of  instructors,  as  well  as 
the  grades  assigned  on  standardization  board  check  flights  at  two  stations, 
tf«M  to  corroborate  the  conduskms  derived  from  the  ratings — that  re¬ 
latively  few  pilots  attract  attention  as  being  particularly  “good”  or  “poor,” 
and  that  there  are  more  “good”  than  “poor”  pilots  in  the  usual  run  of 

For  two  samples  of  25  to  42  pilots  3t  each  of  fov  Basic  Training  Sta¬ 
tions  the  average  total  scores  varied  from  72.0  to  9_  '  with  tandard 
deviations  of  from  7.4  to  16.6.  Average  scores  for  the  flyn.^  *  s  only, 
varied  from  49.9  to  65.2  with  standard  deviations  ranging  from  »o  11.6. 
Trait  items  showed  considerably  less  variation  from  sample  to  sampu  with 
average  scores  between  22.1  and  28.2  and  standard  deviations  of  iron.  1 .2 
to  5.8.  Similar  data  were  available  for  two  samples  at  each  of  four  Ad¬ 
vanced  Training  Stations.  Total  scores  on  the  Advanced  Scale  averages- 
from  66.2  to  78.1  with  stmdard  deviations  ranging  from  6.2  to  :?  8.  Aver¬ 
ages  for  flying  items  ranged  from  24.2  to  27.9  with  standard  deviatons  of 
from  2.8  to  5-3.  Gur.Derv  items  r  "d  from  20.6  to  24.8  in  average  sc.-es 
and  from  2.2  to  7.4  in  standard  deviation.  A.erage  scores  on  trait  itcu*: 
ranged  from  21.4  to  25.4  with  standard  deviations  of  from  2.5  to  4.6.  Varia¬ 
tions  in  score  from  one  sample  to  another  are  seen  to  be  considerably  less 
with  the  Advanced  Training  ratings. 
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e.  RcUabUitUs. — It  was  Dot  possible  to  secure  from  the  training  statkx* 
store  than  a  single  set  of  ratings  on  individual  student  pilot*.  There  it* 
coined  two  other  methods  of  indirectly  estimating  the  reliability  oi  the 
ratings.  The  first  of  these  involved  intercorrrlatioo  of  the  part-scores  on 
both  the  basic  and  advanced  scales.  The  second  approach  was  to  csrrdatn 
the  total  scores  and  part-scores  ca  the  basic  scale  with  tho^g  on  the  ad¬ 
vanced  scale  for  the  same  sample  of  student  pilots.  The  intercontlatfoa  <d 
part-scores  for  the  two  forms  of  the  rating  scale  ranged  from  0.60  Ut  (Lit 
for  3  or  4  samples  from  each  of  four  Basic  Stations.  For  two  tatnpiyt  at 
each  of  four  Advanced  Stations  the  mtcrcorrelations  of  part-scores  ranged 
between  0.49  and  0.98  with  a  median  of  0.66.  The  generally  high  inters 
correlations  for  both  scales  are  probably  indicative  of  the  “halo”  effect 
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usually  found  in  rating  scales  of  this  type,  rather  than  evidence  of  re¬ 
liability.  As  might  have  been  expected,  detailed  examination  of  the  rating* 
revealed  differences  in  the  adequacy  of  the  ratings  from  one  training  flight 
tc  another,  as  indicated  by  range  of  ratings  given,  degree  of  independence 
cl  individual  items,  and  correlation  with  other  proficiency  measures. 

Correlations  between  scores  derived  from  the  basic  scale  and  those 
derived  from  the  advanced  scale  were  computed  for  two  commitments. 
Only  nonexperienced  pDots  were  included  in  the  statistics,  the  results  of 
which  appear  in  table  2. 25.  The  correlation  coefficients  obtained  indicate 
some  degree  of  relation  between  the  ratings  assigned  at  two  different 
phases  of  training  and  by  different  groups  of  instructors. 

c.  Evaluation. — As  with  other  criteria,  a  comparison  was  made  between 
experienced  and  inexperienced  pilots  for  several  samples  of  students  on 
both  the  basic  and  advanced  forms  of  the  scale.  Results  are  shown  in 
table  2.26. 

It  is  difficult  to  tell  whether  the  striking  differences  in  the  table  favoring 
the  former  instructors  were  indicative  of  the  adequacy  of  these  ratings  as 
proficiency  data  or  were  merely  an  i'  dication  of  a  generalized  Ludo  effect 


43 


operating  la  favor  of  the  more  experienced  pilots.  Any  tendency  to  base 
ratings  upon  experience  rather  than  ability  would  also  operate  to  raise 
the  correlations  obtained  between  ratings  on  separate  parts  of  the  scales 
and  between  ratings  at  bask  and  advanced  stations.  Follow- up  visits  to 
the  training  stations  where  the  scales  were  in  use  indicated  that  several  of 
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the  more  common  sources  of  error,  which  usually  operate  where  rating 
scales  are  used,  were  also  influencing  these  ratings.  The  most  serious  draw¬ 
back  was  the  lack  of  specific  causes  on  which  to  base  the  assigned  ratings. 
The  doubtful  value  of  the  printed  proficiency  rating  scales  led  to  tie 
decision  to  substitute  for  them  a  system  of  interviewing  instructors  at  the 
training  stations. 

2.  Instrucior-intcrvio.  ratings,  a.  Description. — Tor  four  commitments 
cf  student  pilots,  aviati  -n  psychologists  in  the  First  Air  Force  visited  the 
advanced  training  stat  ons  and  secured  ratings  of  proficiency  through  de- 


tii Jed  interviews  with  the  instructor?  at  the  conclusion  of  training.  Pouf 
types  of  information  were  secured  from  each  instructor  on  the  student 
p3ots  in  his  Sight:  selection  of  the  most  proficient  and  the  least  proficient 
pilot  in  the  flight;  assignment  of  an  over- all  proficiency  rating  of  pQot 
ability  on  a  five-point  scale;  the  approximate  number  of  missions  flown  with 
escb  student;  the  specific  reasons  behind  the  assigned  raiiegs  in  case 
In  giving  reasons  for  the  ratings  instructors  were  required  to  cover  all  of 
the  major  aspects  of  flying  training  (general  handling  of  the  airplane, 
formation  flying;  execution  of  maneuvers  difficult  to  follow,  aerial  gunnery 
technique,  ground  gunnery  and  strafing  technique,  freedom  from  grriflynts 


Table  221. — Reliability  coefficient:  oj  proficiency  rating:  obtained  from  interwiem 
tcith  instructor:  at  advanced  training  station: 
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or  near-aeddents,  attitude  and  air  discipline).  Particular  emphasis' was 
placed  on  reasons  given  for  extremely  high  or  !ow  profidency  ratings.  These 
comments  or  explanations  of  'he  ratings  were  entered  in  the  notes  of  the 
interview. 

b.  Distributions  and  reliability  o)  interview  ratings. —  The  ratings  ob¬ 
tained  in  the  interviews  were  given  numerical  values  as  follows:  “Above 
average,”  5;  “Slightly  above  average,”  4;  “Average,”  3;  "Slightly  below 
average,”  2;  “Below  average,”  1.  ?n  addition,  ii  a  pilot  was  selected  as  the 
test  pilot  in  the  flight,  the  numerical  rating  given  was  increased  by  1.  If 
selected  as  the  least  profident  man  in  a  flight,  one  point  was  subtracted  from 
the  rating.  The  ratings  of  the  several  instructors  on  a  single  student  were 
averaged  to  yield  a  single  proficiency  measure.  Means  and  standard  devia¬ 
tions  of  ratings,  together  with  reliability  coefficients  obtained  by  correlat¬ 
ing  the  ratings  secured  from  two  different  instructors  are  given  In  table  2.27 
for  the  proficiency  ratings  on  students  in  four  commitments. 

c.  Evaluation. — Comparison  oi  experienced  and  newly  rated  pilots  on 
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the  instructor-interview  ratinp  for  student  pilots  in  two  commitments 
yielded  the  results  in  table  2 Jf. 

The  advantages  of  the  instnictor-interview  ratinp  over  those  obtained 
by  use  of  the  printed  scales  are  the  following: 

(1)  Specific  reasons  can  be  found  for  the  assignment  of  ratinp.  This 
is  especially  important  in  cases  in  which  ratinp  are  obviously  Influenced  by 
personality  factors  rather  than  by  pure  flying  ability. 

(2)  Degree  of  acquaintance  with  the  students’  flying  can  be  taken  into 
account;  instructors  are  excused  from  rating  any  student  in  the  flight  with 
whose  flying  they  are  not  sufficiently  familiar. 

(3)  The  interviewer  has  an  opportunity  to  note  the  relative  ability  and 
willingness  of  the  several  raters  to  estimate  the  proficiency  of  the  student*. 

7  ■:,!*  2.21. — Differences  m  proficiency  ratinp  {obtained  from  instructor  interviews) 
for  AAF  Training  Command  instructors  and  naniy-rated  fiats 
in  advanced  training  stations 
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The  ratinp  of  different  instructors  can  then  l*.  weighted  accordingly  it 
arriving  at  the  total  rating  for  the  student. 

In  the  data  here  reported  the  third  advantage  ;'ven  above  was  not 
utiiized.  Ail  instructors  who  were  able  to  rate  a  studen'  did  so  and  their 
ratings  were  given  equal  weight  in  determining  the  fin^  ’■esult  The 
extent  to  which  instructors  changed  their  ratinp  because  o*  having  to 
justify  the  ratinp  by  specific  reasons  is  not  known.  Interviewers  ‘  ".-c'*ed 
such  changes  were  fairly  frequent 

3.  Rankings  by  instructors. — The  instructors  at  three  stations  of  the 
Second  Air  Force  were  asked  to  rank  their  fighter  pilot  students  in  the 
order  of  their  expected  over-all  effectiveness  in  combat.  The  rankinp 
were  then  converted  to  percent-position  scores  for  validation  studies.  Since 
independent  ratings  of  the  same  students  by  more  than  one  instructor 
were  not  available,  no  reliabilities  were  computed  for  this  criterion.  Be¬ 
cause  instructors  were  asked  to  make  an  over-all  judgment  and  no  guidance 
was  given  as  to  specif.:  items  to  be  considered,  it  is  probable  that  the  rank¬ 
inp  were  based  to  a  great  extent  upon  subjective  factors.  'Also  the  basis 
of  judgment  undoubtedly  varied  greatly  from  one  instructor  to  another. 
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Such  rankings  do  have  the  advantage  of  obtainlrg  a  single  over-all  Judg¬ 
ment  of  proficiency. 

4.  Ratings  by  fellow  students,  a.  Description. — On  a  sample  of  pQote 
*bo  bad  completed  operational  training,  research  personnel  in  the  Second 
Air  Force  secured  proficiency  ratings  from  their  fellow  students.  Each  pilot 
was  asked  to  list  those  of  bis  classmates  he  felt  he  knew  well  enough  to 
rank  in  order  of  proficiency  as  combat  pilots.  He  was  told  to  list  first 
the  pilot  be  thought  would  be  most  proficient,  and  to  place  the  pilot  ho 
thought  would  be  least  proficient  last,  with  the  rest  in  order  in  between. 
With  this  procedure,  pilots  differed  greatly  in  the  number  the/  listed. 
Hence,  there  was  also  great  variation  in  the  number  of  ratings  different 
pilots  received.  What  sort  of  bias  may  have  influenced  the  individual  pilots 
in  their  choice  of  pilots  to  be  listed  was  not  known.  Statistical  treatment 


Table  2J9. — Correlations  between  percent-position  score:  dtrrctd  ft  a m  ranks 
assigned  by  odd  and  eve*  raters 
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of  the  data  was  restricted  to  the  rankings  of  those  pilots  who  had  been 
listed  by  four  or  more  of  their  classmates. 

b.  Reliabilities. — Correlations  were  computed  between  the  average  per¬ 
cent-position  scores  for  the  listings  of  odd  and  even  classmates.  The  co¬ 
efficients  art  listed  in  table  2.79,  for  those  stations  from  which  data  were 
obtained.  The  percent-positio'  score  in  each  case  was  the  percentile  rank 
corresponding  to  the  position  af  the  pilot  in  the  list  of  one  of  the  raters. 
Fifty-three  of  the  student  p'^ots  were  rated  by  eight  or  more  classmates. 
The  odd-even  reliability  fo  this  group  of  ratings  was  .74.  These  data 
show  that  ratings  by  a  nur.oer  of  fellow  students  may  be  expected  to  yield 
estimates  of  proficiency  .  *  sufficient  reliability  to  the  be  useful  measures  of 
proficiency.  Whether  'ne  bases  of  rating  were  valid — i.e.,  were  measures 
of  combat  proficie'.  ■>-— could  not  be  determined  with  the  data  at  hand. 

Plying  Evalr.'jn  Board  Reports 

Anal'.--  of  records  on  fighter  pilots  who  were  called  before  Hying 
Evv  .<.ion  ^ards  have  been  reported  from  the  First,  5  econd,  and  Fourth 
y  Forces.  Results  of  the  analysis  of  Flying  Evaluation  Board  cases  were 
sported  in  terms  of  the  cause  for  meeting  the  board  (e.g.,  lack  of  profi¬ 
ciency,  fear  of  flying,  physical  defect,  disciplinary  reasons,  etc.).  Since  data 
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from  these  studies  have  already  been  presented  in  another  section  in  the 
discussion  of  job  specifications  for  fighter  pilots  (see  page  25)  and  since 
there  was  no  method  of  determining  their  reliability,  no  further  presenta¬ 
tion  of  these  data  Is  necessary  here.  Tne  small  number  of  cases  re¬ 
evaluated  in  all  of  the  four  continental  air  forces  places  severe  limitations 
on  the  usefulness  of  this  criterion  of  fighter  pilot  proficiency. 

Akcrajt  Accidents 

1.  Description. — Surveys  of  aircraft  accident  reports  have  been  made  by 
all  four  of  the  Air  Force  units.  The  approach  in  all  cases  was  to  analyze 
the  information  from  the  Accident  Board  Reports  on  file  at  the  Air  Force 
Headquarters  and  then  to  set  up  various  accident  categories  for  subsequent 
conjt'iison  as  to  i.inines  and  classification  test  scores.  The  categories 
se'.‘  ted  for  stanine  validation  varied  somewhat  from  one  Air  Force  unit  to 
another,  but  gene- ally  included  several  of  the  foOowing: 

a.  Accident  cz  ies  of  all  kinds 

b.  Pilot-error  Accident  cases 

c.  Non-pilot-error  accident  cases 

d.  Accident  cases  of  unknown  causation 

e.  Accident-free  population  (or  an  accident-free  control  group) 

f.  Single  accident  cases  and  multiple  accident  cases 

g.  Fatal  accident  cases  and  non- fatal  accident 

h.  Non-injury  or  sJight-injury-to-personnel  raws 

L  Cases  of  severe  injury  to  personnel 

i.  Cases  involving  slight  damage  to  aircraft 

k.  Cases  involving  heavy  or  complete  damage  to  aircraft 
Since  the  several  categories  were  not  exactly  comparable  from  one  air 
force  to  another,  a  summary  table  of  frequencies  in  each  categi  y  could  not 
be  derived  from  the  data  which  were  available. 

2.  Reliability. — Because  of  the  small  number  of  pilots  who  were  in¬ 
volved  in  more  than  one  accident  due  to  pilot  error,  there  i«  no  feasible 
method  of  estimating  the  reliability  of  aircraft  accidents  as  a  criterion  of 
fighter  pilot  proficiency. 

3.  Analysis  oj  psychological  reasons  for  accidents. — A  detailed  psycho¬ 
logical  analyris  of  pilot-error  accidents  was  attempted  by  First  and  Second 
Air  Force  research  personnel.  The  results  of  their  analyses  have  been  pre¬ 
sented  in  an  earlier  section  of  this  chapter  (see  page  25)  in  connection  with 
the  discussion  of  job  specifications.  One  serious  difficulty  in  the  way  of 
arriving  at  significant  categories  cf  accident  causation  lay  in  the  nature  of 
the  Accident  Board  Reports,  in  which  the  degree  of  pilot  responsibility  was 
frequently  difficult  to  assess  from  the  information  given.  Though  the  sepa¬ 
rate  agreement  among  the  psychologists  in  the  two  \ir  Forces,  who  acted 
as  a  jury  in  making  the  analysis  of  the  accident  records,  wa3  faiily  satis¬ 
factory  in  both,  the  value  of  the  resulting  trait  frequencies  is  perhaps  open 
to  debate.  Such  agreement  could  be  brought  about  by  stereotyped  ideas  of 
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the  nature  of  certain  accidents  operating  either  in  the  psychologists  acting 
as  the  jury  or  in  those  reporting  the  details  of  the  accidents.  Besides,  the 
gfiraH  number  of  available  cases  restricts  the  value  of  any  conclusions  sug¬ 
gested  by  these  analyses.  Certainly  there  were  extensive  disagreements  be¬ 
tween  the  distributions  obtained  in  the  two  Air  Forces. 

In  the  Second  Air  Force  a  special  study  was  made  of  the  degree  of 
agreement  between  different  judges  in  the  psychological  reasons  ascribed  to 
the  accidents.  In  table  2  JO  are  listed  the  frequencies  of  agreement  and  dis¬ 
agreement  among  four  psychologists  using  successively  5,  8  and  \i  cate¬ 
gories  of  reasons.  There  was  obviously  greater  agreement  when  a  few 
general  psychological  categories  were  used  than  when  there  was  a  larger 
number  of  more  specific  categories  from  which  to  choose.  Since  one  would 
expect  a  greater  degree  of  agreement  just  by  chance  when  categories  are 
few,  coefficients  of  contingency  were  computed  to  express  the  extent  to 
which  the  observed  agreement  differed  from  chance  expectations.  Separate 


Tasle  2 SO. — Percent  of  Occidents  classified  t, t  the  r.uinnce  by  four  fudges 
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coefficients  were  computed  for  the  compaiisons  of  the  classifications  of  each 
pair  of  judges.  The  average  coefficients  obtained  for  all  pairs  were  0.56, 
0.71  and  0.76  for  the  5,  8  and  15  category  classifications  respectively.  That 
the  greatest  superiority  over  chance  agreement  occurred  with  the  15  cate¬ 
gory  classifications  was  contrary  to  expectations  from  the  data  in  table 
2.30.  Even  discounting  the  fact  that  the  maximum  possible  coefficient  is 
higher  for  comparisons  based  on  larger  numbers  of  categories,  there  still 
remains  evidence  of  better  agieement  in  discrimination  of  reasons  for  acci¬ 
dents  when  the  categories  are  many  and  specific.  The  data  are  not  suf¬ 
ficient  to  provide  any  further  evidence  o>;  this  point  , 

4.  Evaluation. — It  is  difficult  to  evaluate  aircraft  accidents  as  a  criterion 
of  fighter  pilot  proficiency.  Opinions  of  instructors  and  of  flying  safety  of¬ 
ficers  varied  widely  as  to  whether  or  not  accident  occurrence  was  indicative 
of  low  pilot  aptitude.  It  was  commoniy  asserted  by  supervisory  personnel 
in  the  training  stations  that  “any  pilot  can  have  an  accident!”  On  the  other 
band,  some  felt  that  almost  all  accidents,  even  those  reported  as  caused 
by  materiel  failure,  were  evidence  of  seme  lack  of  proficiency  on  the  part 
of  the  pilot.  However,  it  is  logical  to  assume  that  large  numbers  of  acci¬ 
dents  in  operational  training  originated  from  circumstances  over  which  the 
pilot  had  no  control,  such  as  materiel  failure,  idverse  weather  conditions,, 
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etc  Even  in  accident  ci<**  where  pilot  error  may  have  contributed  to  the 
severity  of  the  accidents,  there  is  considerable  disagreement  by  the  pilots 
oo  the  accident  boards  regarding  the  assessment  of  responsibility. 

The  number  of  pOot-error  accidents  was  too  small  to  warrant  very  much 
emphasis  upon  a  statistical  study  relating  accident  occurrence  to  other 
measures  of  pilot  proficiency  such  as  gunnery  scores,  mission  card  coo* 
men  is,  proficiency  ratings,  tower  reports,  etc  Furthermore,  the  number  of 
accident  repeaters  is  so  small  as  to  preclude  any  decision  as  to  the  re-  1 
liability  of  accident  occurrence.  The  only  statistical  evidence  regarding  the 
usefulness  of  this  criterion  is  given  in  a  First  Air  Force  study  comparing 
the  accident  frequency  among  experienced  and  inexperienced  pilots.  These 
data  are  given  in  table  2J1. 
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Time  Required  to  Complete  Tr tuning 

1.  Description. — There  are  extensive  individual  differences  among  stu¬ 
dent  pilots  in  the  time  elapsing  between  the  start  of  operational  training 
and  the  completion  of  training  and  assignment  to  staging  stations.  Time 
may  be  lost  in  the  basic  and  advanced  phases  of  training  because  of  many 
factors:  grounding  because  of  physical  disability,  prolonged  adverse  weather 
conditions,  inadequate  number  of  operational  aircraft,  emergency  leaves, 
changes  in  commitment  requirements,  etc.  Except  for  the  first  and  last  of 
these  factors,  however,  their  influence  upon  a  population  ol  student  pilots 
is  probably  random.  The  belief  is  often  expressed  by  supervisory  personnel 
in  field  training  stations  that  more  proficient  pilots  complete  then 
training  (on  the  average)  more  rapidly  than  less  proficient  pilots.  Studies 
were  undertaken  in  the  First  and  Second  Air  Forces  to  discover  the  relation 
of  pilot  stanine  to  the  time  required  to  complete  operational  training  in  the 
P-47  airplane. 

In  the  First  Air  Force  study  three  measures  of  time-in-training  were 
used:  (1)  number  of  months  required  to  accomplish  basic  training; 
(2)  number  of  months  spent  in  advanced  training;  (3)  number  of  months 
required  to  complete  basic  and  advanced  training  combined.  Student  pilots 
with  no  previous  experience  as  instructors  who  completed  training  in  the 
May,  June,  and  July,  commitments  in  the  I  Fighter  Command  were  used 
in  the  study.  In  the  Second  Air  Force  three  scores  were  derived  from  the 
training  progress  charts  for  pilots  in  the  December  1944  commitment  at 
the  end  of  their  fifth  week  of  training.  One  score  represented  a  weighted 


icore  based  on  number  of  missions  reported  (repeated  missions  were  fhrea 
jess  weight),  another  was  the  cumber  of  hours  Gown  and  the  third  rep¬ 
resented  the  number  of  AAF  standards  completed.  The  data  from  both  ah 
fortes  revealed  that  in  all  of  the  scores  obtained  there  was  considerable 
variation  between  stations  and  between  classes  or  commitments  at  the  same 
station. 

2.  Reliabilities. — There  seemed  to  be  no  feasible  method  of  estimating 
the  reliability  of  the  above  measures  other  than  by  correlating  the  time 
spent  in  basic  training  with  that  spent  in  advanced.  In  three  commitments 
of  more  than  100  pilots  each  the  coefficients  ranged  from  —0.42  to  0.50 
with  an  average  of  — 0.02  for  the  356  pilots  in  the  total  group.  The  data 
showed  a  zero  relationship  between  time  spent  in  the  two  phases  of  train- 
in".  Investigation  of  samples  of  data  from  different  training  stations  re¬ 
vealed  that  there  were  unexplained  but  fairly  consistent  (and  often 


Tabu  2-52. — Differences  in  time  required  to  complete  operational  training  for 
Training  Command  instructors  and  newly -rated  pilots 
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statistically  significant)  differences  from  station  to  station.  These  dif¬ 
ferences  probably  operated  to  obscure  the  true  significance  (if  any)  of 
time-in-training  as  a  possible  criterion  of  fighter  pilot  proficiency.  Time 
spent  in  basic  training  did  discriminate  between  experienced  and  inexperi¬ 
enced  pilots,  as  shown  in  table  2.32.  The  data  for  advanced  training  are 
less  clear  cut 

4.  Evaluation. — In  evaluating  time- in- training  as  a  possible  criterion,  the 
following  points  have  to  be  considered.  First,  it  was  extremely  difficult  to 
obtain  records  of  actual  fiyable  time  as  distinguished  from  mere  presence 
at  a  training  station.  Administrative  reasons  for  loss  o»  flying  time  and 
legitimate  grounds  for  periods  of  indefinite  suspension  from  flying  further 
complicated  the  picture.  It  would  be  necessary  to  make  a  detailed  examina¬ 
tion  of  each  student  pilot’s  Form  5  and  to  secure  the  needed  information 
from  the  supervisors  of  dying  training  (relative  to  lack  of  aircraft,  poor 
weather,  commitment  requirements,  etc.)  'o  obtain  a  thorough  and  accurate 
analysis  of  the  time-in-training  criterion. 

Furthermore,  in  connection  with  use  of  this  criterion  in  validity  studies, 
it  has  been  shown  that  for  each  successive  das?  graduating  from  the  Tr 
ing  Command  since  Class  43-G,  the  average  stanines  have  been  higher.  (See 
report  number  2).  Thus,  even  though  th-;re  were  no  genuine  relationship 
between  time-in-training  and  pilot  stanine,  a  spunous  relationship  might  be 
obtained  from  the  data,  since  in  the  same  I  Fighter  Command  commitment, 
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tors  from  the  earlier  Training  Command  classes  would  sham,  oo  the  ever* 
age,  both  &  looses'  trne-in-traiiatf  and  a  lover  staaiae  Against  ths 
interpret!  ooo  is  the  fact  that  the  esperieacxrf  asi  ^experienced  pilots 
shoved  a  dear-cut  difference  ia  time  taken  to  cocaplete  the  basic  phase  si 
training  Final  evaluation  c '  time-to-compJete  trahan^  and  similar  measures 
would  require  additional  study  and  analyses  designed  to  control  the  elects 
cl  some  of  the  important  factors  influencing  such  a  measure. 

Retention  oj  Sindents  <t  mstrmcUn 

During  the  latter  part  of  1943  and  continuing  tp  to  about  August  1944, 
a  number  of  student  pile's  in  'be  I  Fighter  Command  were  retained  at  the 
bask  and  advanced  training  stations  after  the  completion  of  nprratin-d 
training  as  rest:  ctors  to  replace  those  moving  on  to  combat  theaters. 

.pqvisyy  personnel  at  the  training  stations  agreed  that  these  trainee  pints 
were  selected  as  instructors  for  having  demonstrated  unusual  proficiency 
during  their  period  of  tr.  inmg.  A  total  population  of  209  of  these  pilots 
was  uncovered  after  search  through  the  files  at  TTrarlqra»rt<»r«  J  Fighter 
Command.  This  population  was  taken  as  a  selected  group  of  high- 
proficiency  student  pilots  against  which  to  validate  the  vtaniw* 

As  a  criterion  of  proficiency,  retention  as  an  instructor  is  open  to  a  num¬ 
ber  of  objections.  There  was  almost  no  way  of  determining  the  reliability 
of  the  decisions  made.  Also,  the  numbers  involved  were  so  small  that  do 
extensive  studies  could  be  made.  It  is  likely  that  some  subjective  factors 
entered  into  the  decision,  and  the  basis  of  decision  may  have  varied  from 
(me  station  to  another.  However,  as  a  group,  the  students  retained  as  in¬ 
structors  were  undoubtedly  outstanding  in  proficiency.  Finally,  the  over-all 
type  of  judgment  required  in  deriding  which  pilots  were  retained  was 
probably  based  upon  excellent  coverage  of  all  aspects  of  the  job. 

Written.  Proficiency  Tests 

1.  Description. — At  the  request  of  the  Wing  Director  of  Training,  re¬ 
search  personnel  from  the  Second  Air  Force  aided  in  the  development  of  a 
written  proficiency  test  for  P-47  pDots.  After  construction  of  the  test  by 
Instructors  of  the  Wing,  the  research  personnel  did  a  statistical  analysis  of 
the  results  of  a  preliminary  administration  to  48  fighter  pilots  who  had 
completed  operational  training.  The  test  consisted  of  373  items  distributed 
among  eight  parts  or  sections. 

2.  Reliability.—' The  odd-even  reliability  coefficients  for  each  of  the  eight 
parts  of  the  test  were  as  given  in  table  2.33  below. 

An  item  analysis  was  also  carried  out,  from  the  lesults  of  which  recom¬ 
mendations  for  revision  of  the  test  were  made  to  the  Wing  Director  of 
Training. 

3.  Evaluation. — Although  written  proficiency  tests  meet  most  of  the 
requirements  of  a  good  criterion  (such  as  reliability  of  scores,  objectivity, 
and  high  degree  of  discrimination  between  individuals),  there  is  one  im» 
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portent  requirement  la  which  they  u«  deficient.  They  do  not  wVifhtj 
cover  the  job  of  (be  fighter  pilot;  and  there  b  little  evidence  as  to  bow 
dosdy  scores  oa  soch  tests  are  related  to  sacctss  is  combat  tfirrirtnoa 
For  these  reasons  scores  oo  written  proficiency  texts  can  only  be  ned  to 
supplement  other  measures  of  proficiency.  Used  io  this  marrer,  they  ihoir 
lave  some  value  in  measuring  fighter  pilot  proficiency. 


C— ild nation  wf  Criteria 

Where  no  one  oiterioo  provides  an  adequate  measure  cf  proficiency  it  is 
sometimes  possible  to  meet  the  requirement  of  adequate  coverage  of  tkc 
job  by  combining  various  criteria,  each  of  which  is  based  npn  ooiy  one 
of  several 't  i*s  important  features.  Thus  several  combinations  of  criteria 
were  tried  out  in  the  various  Continental  Air  Forces.  The  most  extensive 


Tuu  JJI- — Odi~€*em  rc&cb&iy  taefraents  Jot  wrktc*  frtJUicmcy  M 
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M  MlWHl 

A.  Nature  and  characteristics  of  the  aircraft  . 043 

B.  Orientation  and  iatdSgeace  .  .U 

C  Regulations  and  technical  subjects  . 56 

D.  Recognition  (air  and  sea)  .  JS 

£.  Armament  and  pmeiy  .  J5 

F- Tactics  . 51 

G.  Survival  . St 

H.  Military  subjects .  51 

Total  test  . '~39 


combinations  were  used  in  the  First  Air  Force.  In  a  preliminary  study  the 
separate  criterion  scores  were  in  each  case  combined  after  transmuting  raw 
scores  to  standard  scores  with  a  mean  of  SO  and  a  standard  deviation  of 
10.  Combinations  were  first  made  of  air-to-air  and  air-to-ground  gunnery 
scores  to  form  a  single  gunnery  criterion  for  all  pilots  on  whom  both 
measures  were  available.  For  the  May,  June,  July  and  August  1945  com¬ 
mitments,  combinations  were  made  of  guiinery  scores,  ratings  from  banc 
stations  and  interview  ratings  from  advanced  stations.  Finally,  a  com¬ 
bination  of  all  available  criteria  was  used  to  obtain  two  extreme  groups  of 
“high”  and  “low”  proficiency  for  use  in  test  validation.  Details  c*  the 
various  procedures  are  given  in  the  section  on  Validation.  In  the  Second 
and  Fourth  Air  Forces  a  two-category  critericu  was  obtained  by  combining 
pilots  with  aircraft  accidents  and  re-evaluated  pilots  into  failure  groups  for 
use  with  groups  of  successful  pilots  as  a  pass- fail  criterion  in  operational 
training.  Since  the  number  1  hat  had  accidents  and  the  number  re-evaluated 
were  both  small,  such  a  procedure  had  the  advantage  of  providing  a  larger 
number  in  the  failure  ca  teg  Dry  for  any  two-category  statistical  computa¬ 
tions. 
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MeUtims  Bth***  Grterft  _ _ 

pm  am  teatctiduiw  uaocg  the  jerml  pwfickaqr  » 

fghtfr  pilot*  bare  bee*  reported  tnm  the  First,  Second,  Air 

Forces.  These  <?»*****  hire  n  tapori-UJt  bearing  on  the  derision  **  to 
the  identic  end  camber  of  separate  criteria  needed  to  seme  adequately 
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for  classification  test  validation  purposes.  The  results  of  in tercorr elation 
studies  reported  from  the  various  Air  Forces  are  summarized  in  table  2M. 
Except  where  otherwise  indicated  the  coefficients  listed  are  averages  (by 
Fisher’s  *)  of  separate  coefficients  for  the  different  classes  and  stations. 

The  correlation  coefficients  obtained  among  the  various  proficiency 
measures  on  P-47  pilots,  while  generally  low,  are  consistently  positive 
from  sample  to  sample  and  appear  to  be  indicative  of  a  genuine  relation 
among  the  measures.  It  is  difficult  to  determine  to  what  extent  the  low 
magnitude  of  these  correlations  reflects  true  independence  of  the  various 


54 


aitrrioa  masons  wd  hew  much  it  results  m erdy  froca  the  low  rtUibatty 
of  the  measures  thetesehrs.  If  these  results  be  taken  to  indicate  cooskkr- 
ibk  independence  of  the  several  criteria,  it  oust  be  concluded  that  an  coe 
or  two  of  them  adequately  covers  the  area  of  fighter  pilot  prefidescy,  The 
data  reported  from  the  F>urtV  Air  Force  must  be  interpreted  in  the  dgkft 
of  the  low  reliability  (031-  of  the  air-to-air  gunnery  scores  obtained  thc  i 
What  evidence  there  is  would  indicate  that  mission  grades  and  various  types 
of  ratings  have  the  most  in  common  with  the  ether  criteria. 

i 

Owcr-sB  Evdmtiom 

1.  The  quantitative  semes  derived  from  gunnery,  toebbg  and  rocket 
firing  are  protx.-  bly  the  best  criteria  under  the  standards  oo  page  24.  Their 
dstribution  is  fair  and  has  improved  with  recent  emphasis  on  gunnery 
training  methods  and  accuracy  of  recording;  the  reliability,  while  not  high, 
is  acceptable;  they  discriminate  between  experienced  and  inexperienced 
student  pilots;  while  subject  to  a  cumber  of  clerical  errors,  they  are  free 
from  the  more  important  errors  of  subjective  judgment;  they 'cover  an  im¬ 
portant  part  (though  not  all)  of  the  area  of  fighter  pilot  training. 

2.  The  data  from  individual  mission  cards  provide  another  good  criterion 
source.  This  is  especially  true  of  the  comments  made  by  instructors  on 
specific  behavior  observed  during  the  flight.  Pilot  proficiency  scores  de¬ 
rived  from  the  comments,  though  poorly  distributed,  have  adequate  re¬ 
liability,  discriminate  between  experienced  and  inexperienced  pilots,  me 
relatively  free  from  subjective  judgment  errors  (being  related  to  actually 
observed  instances  of  flying)  and  cover  all  aspects  of  training  since  they 
can  be  made  after  every  flight.  Grades  on  the  misrien  cards  provide  less 
satisfactory  criterion  data,  being  too  subject  to  subjective  impressions, 
“halo”  effect,  and  hasty  generalizations;  their  distribution  is  very  unsatis¬ 
factory,  there  being  far  too  little  scatter  of  assigned  grades. 

2.  The  mobile  control  unit  (and  control  tower)  reports  afford  criterion 
data  which  potentially  might  serve  to  supplement  other  criterion  measures. 
As  received  from  the  training  stations,  distribution  is  not  satisfactory; 
there  is  no  measure  of  reliability;  they  do  discrim  nate  successfully  be-* 
tween  experienced  and  inexperienced  pilots;  they  are  free  from  errors  of 
personal  bias,  but  are  subject  to  careless  recording;  they  sample  only  a 
relatively  small  and  less  important  part  of  flying  in  fighter  type  operational 
|  aircraft, 

4.  Proficiency  ratings  assigned  at  the  end  of  training  on  printed  forms . 
may  be  rejected  as  being  too  susceptible  to  all  sorts  of  subjective  errors, 
failing  to  cover  the  whole  course  of  training  adequately,  and  being  poorly 
distributed.  Proficiency  ratings  secured  from  inte  "views  with  ins  true  ton?  at 
the  completion  of  training  have  several  advantages  over  those  assigned  on 
printed  forms.  A3  secured  in  the  First  Air  Force,  the  distribution  of  ratings 
is  good;  reliability  (agreement  among  instructors)  is  satisfactory;  they 
discriminate  between  experienced  and  inexperienced  pilots;  they  obviate 
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subjective  errors  to  a  great  degree  by  being  supported  by  specific  evidence: 
they  cover  the  course  of  training  wefl  since  several  instructors  are  inter¬ 
viewed  to  include  all  types  of  missions.  These  ratings  are  no  doubt  some¬ 
what  subject  to  hasty  generalization,  and  also  to  memory  errors.  However, 
they  probably  pick  out  the  best  and  poorest  pilots  quite  accurately,  since 
these  students  have  made  more  in^xession  upon  instructors. 

5.  Insufficient  research  has  been  dene  on  aircraft  accidents  to  enable  an 
assessment  to  be  made  as  to  ’he  adequacy  of  this  criterion.  The  distribn. 
tion  is  poor;  no  estimate  of  reliability  is  possible;  adequate  data  ast-  not 
available  as  to  the  comparative  accident  frequency  among  experienced  and 
nooexperiencsd  pilots;  assessment  of  pilot  responsibility  by  the  Accident 
Boards  is  not  entirely  free  from  errors  of  subjective  judgment;  accidents 
may  (and  do'  occur  at  all  stages  of  training  and  experience. 

6.  Cases  of  pilots  called  before  the  Flying  Evaluation  Beards  for  flying 
deficiency  might  be  expected  by  many  to  provide  an  excellent  criterion, 
comparable  at  the  operational  level  of  training  to  the  graduation-elimina¬ 
tion  criterion  in  the  Training  Command  flying  schools.  Practically,  tbr 
number  of  cases  re-evaluated  in  the  Continental  Air  Forces  is  too  small  to 
furnish  an  adequate  criterion  for  classification  test  validation.  The  small 
number  of  men  re-evaluated  for  flying  deficiency  in  operational  trailing 
probably  reflects  in  part  training  policies  and  partly  the  previous  scrap¬ 
ing  at  the  classification  centers  and  flying  schools  of  the  -Training  Corn- 
m?»d.  This  criterion  could  ptobably  be  greatly  improved  if  there  were 
sense  means  of  identifying  border-line  cases,  both  those  that  were  eventually 
redaosified  and  those  that  were  returned  to  flying  status.  Also  score  meam 
of  estimating  the  degree  of  reliability  of  FEB  action  would  permit  a  better 
assessment  than  is  now  possible  of  its  usefulness  in  criterion  studies. 

7.  It  is  difficult  to  evaluate  time  taken  to  complete  training  as  a  criterion 
shy*  there  is  no  practical  way  of  estimating  its  reliability.  It  is  subject  to 
a  best  of  variable  factors  which  would  prove  most  difficult  to  control.  It 
has  the  advantage  of  being  objective  and  relatively  free  from  subjective 
errors.  It  also  provided  an  overall  assessment  based  on  most  aspects  of 
operational  training.  This  criterion  probably  more  nearly  achieves  an  ob¬ 
jective  measurement  of  the  important  factor  of  motivation  than  does  any 
olher  measure  so  far  studied. 

8.  The  foregoing  survey  of  proficiency  measures  would  seem  to  warrant 
the  conclusion  that  among  records  currently  available  gunnery  and  bombing 
scores,  and  mission  card  comments  provided  the  best  criterion  measures  of 
fighter  pilot  success  in  operational  training.  Proficiency  ratings  secured  by 
interview  with  instructors  also  appear  to  have  afforded  a  good  criterion. 
It  further  seems  apparent  that  no  one  of  the  above  criteria  covered  all  as¬ 
pects  of  fighter  pilot  training  comprehensively  enough  to  serve  as  the  sole 
instrument  for  validating  the  classification  tests.  From  a  superficial  evalu¬ 
ation  of  the  available  data  it  would  seem  that  the  smallest  number  of  sepa¬ 
rate  proficiency  measures  which  would  accomplish  this  puipose  would  be 
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tbe  objective  records  obtained  from  gunnery,  bombing  and  rocket  firing  tad 
tbe  specific  comments  recorded  on  mission  cards.  It  might  be  pointed  oat 
tbit  were  uniform  regulations  for  the  recording  and  collection  of  these  pro¬ 
ficiency  data  to  be  issued  and  enforced  in  all  commands  the  statistical 
handling  of  such  data  would  be  somewhat  simplified  and  greater  reliability 
of  scores  should  result  from  the  elimination  of  some  of  the  now  uncontrolled 
variability. 

VALIDATION 

One  of  the  primary  goals  of  the  Aviation  Psychology  Program  in  die 
Continental  Air  Forces  was  to  validate  the  procedures  used  in  the  AAF 
Training  Command  in  the  selection  and  classification  of  aircrew  officers. 
However,  because  of  difficulties  encoun'ered  in  obtaining  adequate  measure* 
of  proficiency,  research  personnel  wc.k-ng  with  fighter  pilots  and  bombard* 
meat  crews  were  forced  to  spend  cons.  Jerable  time  and  effort  in  searching 
for  and  developing  criteria  of  proficiency.  The  results  of  such  activity  with 
fighter  pilots  have  been  discussed  in  the  previous  section  on  Criteria.  Only 
after  these  studies  had  been  accomplished  was  it  possible  to  detenume  ade¬ 
quately  the  relationship  between  the  aptitude  scores  or  stanines  of  the 
fighter  pilcis  and  their  degree  of  success  in  operational  training.  It  had 
also  been  intended  that  studies  would  be  made  of  the  relation  between 
scores  on  the  individual  classification  tests  and  success  in  operational  train¬ 
ing.  However,  only  a  few  studies  of  the  validity  of  individual  classification 
tests  were  accomplished. 

In  the  discussions  of  validities  of  stanines  and  test;  in  this  and  succeeding 
chapters  all  validity  coefficients  that  are  significant  at  the  1  percent  level 
(i,e..  could  occur  by  chance  less  than  1  time  in  100)  are  identified  with 
two  asterisks.  Those  coefficients  that  are  significant  at  the  5  percent  level 
aie  marked  with  a  single  asterisk.  Validities  of  stanl  es  are  presented  first, 
followed  by  data  on  test  validities  at  the  end  of  the  section.  Separate  co¬ 
efficients  are  presented  for  each  of  the  criteria  studied,  as  well  as  for  cer¬ 
tain  combinations  of  criteria. 

Stanine  Validation  v 

Fixed  Gunnery ,  Bombing  and  Rocket  Firing 

The  abP-:y  to  hit  a  moving  or  stationary  target  with  either  guns,  bombs 
or  rock 'is  is  the  ultimate  aim  of  all  fighter  pilot  training.  Fixed  gunnery, 
bonv.'ng  and  rocket  firing  scores  thus  naturally  become  the  most  obvious 
cn.'jsures  of  fighter  pilot  proficiency.  Most  of  the  validity  studies  of  the 
<-»lot  stanine  have  therefore  been  made  against  these  criteria. 

The  correlations  of  the  pilot  stanine  against  aerial  and  ground  gunnery 
scores  for  all  stations  and  commitments  combined  are  shown  in  table  2.35 
for  pilots  in  the  First,  Second  and  Fourth  Air  Forces, 

These  coefficients  were  computed  separately  for  each  class  or  commit* 
ment  and  station  and  were  averaged  by  Fisher’s  z  to  produce  the  coefficients 
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hccanpartad.  lamination  o f  the  wptmlt  codfidests  for  di&e rent  riiwn 
It  the  tint  Air  Force  revealed  that  slightly  more  that  half  of  then  Ml 
withto  pine  or  mlaus  1  PJL  of  0.15,  ttewnit^  aa  N  of  SO  (approximate 
average  eiae  of  date).  Distribution  of  validity  coefficients  Ic  the  other 
Ak  Forcer  appeared  to  bo  similar  in  tile  respect  The  validity  of  pilot 
etar.iae  against  gunnery  T-scores  is  the  First  Ah:  Force  which  represented 
an  equally  weighted  combination  of  grows?  sal  alr-Untir  gunnery  scores, 
war  found  to  bo  .14**  or  slightly  less  than  tht  vJ-Ji ty  afxinst  air-to-air 
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It  has  bcec  demonstrated  in  tha  section  describing  the  criteria,  that 
gunnery  scone  tend  to  fall  toward  the  low  ead  of  the  scale  of  scorea.  Also, 
because  of  th*  selective  processes  operating  throughout  the  student  officers* 
period  of  training,  many  torn  with  low  etarfnae  have  been  eliminated  before 
reaching  operational  training,  so  that  the  stanftie  distribution  of  all  men  in 
training  in  the  Air  Forces  is  skewed  in  the  opposite  direction  from  the 
gunnery  scores,  most  of  the  pilots  having  high  stanines.  A  situation  exists, 
therefore,  In  which  the  chances  ate  highly  favorable  for  high  stanlne  Id* 
dhriduils  to  obtain  low  gunnery  scons.  This  situation,  plus  the  unreli¬ 
ability  of  the  criteria,  partially  explains  the  low  correlations  obtained  be¬ 
tween  the  stanines  and  gunnery  scores.  A  truer  picture  of  the  predictive 
ability  of  the  stanines  may  be  seen  from  an  examination  of  table  2J6 
which  shows  the  distribution  by  stani.ae  of  combined  T-scores  representing 
aerial  and  ground  gunnery  for  newb  rated  pilots  only.  It  may  be  seen 
from  this  table  that  some  high  stanlnv  mot  make  just  as  low  worst  as  low 
ctanine  men,  but  low  stanlne  men  do  x>t  make  as  high  scorea  aa  men  with 
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high  sunines.  This  difference  b  expressed  by  the  percent  of  student  of¬ 
ficers  that  exceed  the  mean  of  the  group  at  each  stanine  bd 

Dive  Bombing  end  Skip  Bombing 

Only  a  few  dive  and  skip  bombing  scores  were  collected,  mest  of  which 
were  obtained  in  the  Fourth  Air  Force.  Th*  product-moment  correlations 
of  these  scores  with  pilot  stanine  are  presented  in  table  2J7. 

Tabu  2J7 .—Comlotlons  of  pilot  stanine  with  in*  and  skip  bombing  scons 
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Slip  botsbiac,  mind . J  64  6.70  j  1.69  j  66.0  j  19.5 

1  Correlation  coefficients  were  sot  determined  from  these  ssapks. 

Steel  Scores 

Skeet  scores  were  obtained  for  fighter  pilots  in  training  at  two  Second 
Air  Force  stations.  The  correlation  between  augmented  pilot  stanine  and 
skeet  score  was  0.28**  for  112  cases. 

Mission  Grades  and  Comments 

One  training  station  in  the  First  Air  Force  and  three  stations  in  the 
Fourth  Air  Force  systematically  required  their  instructors  to  give  each 
student  an  overall  rating  or  grade  on  every  mission  flown.  In  addition  to 
these  grades  instructors  were  encouraged  to  comment  on  the  excellencies 
or  faults  observed  in  the  flying  of  the  missions.  The  correlations  of  the 
pilot  stanine  with  the  overall  grades  and  with  scores  derived  from  the  orna¬ 
ments  are  shown  in  table  2.38.  It  is  to  be  noted  that  the  correlations  of 

Table  2.38. — Relation  of  pilot  stanine  to  mission  card  grades  and  comment  sores  ■ 
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the  stanines  against  the  scores  derived  from  comments  are  all  significant 
at  the  ooe  percent  level. 

Tower  Reports  or  Mobile  Control  Violations 

The  number  of  violations  of  flying  safety  procedures  or  Instances  of  grow 
errors  in  taxiing,  take-offs,  flying  the  traffic  pattern  and  in  landing  offers 
a  partially  objective  measure  of  basic  flying  skills.  Unfortunately  few  sta¬ 
tions  in  the  Continental  Air  Forces  maintained  adequate  records  of  these 
observations.  The  correlation  between  the  numbers  of  errors  recorded  at 
two  First  Air  Force  Stations  and  the  stanines  of  the  pilots  concerned  was 
.14**  for  552  pilots.  This  coefficient  represents  the  average  (by  Fisher's 
s)  of  separate  coefficients  for  different  classes  and  stations. 

A  study  was  mad"-  in  the  Second  Air  Force  of  the  landing  discrepancies 
nr  ‘.  d  in  the  landings  of  student  pilots  during  a  sixty  day  period  at  Strother 
Field.  Two  types  of  scores  were  obtained  for  each  pilot:  percent  of  land¬ 
ings  for  which  errors  were  noted;  and  average  number  of  errors  noted  per 
landing  made.  In  table  2.39  are  given  the  correlations  between  these  two 
types  of  scores  and  the  staninzs  of  the  pilots  involved. 


Tabu  2-39. — Correlations  between  landini  discrepancies  and  stanines 
SS  STUDENT  PILOTS— SECOND  AIK  FORCE 


Type  or. .  •mines 

Stanines 

Percent  of  landings 
with  errors 

Avenge  number  of 
errors  per  Sanding 

Mean 

S.D. 

Mean 

S.  D. 

Mean  1 

i 

S3 

rSta. 

7.01 

1.60 

33.6 

21 

frn 

31 

0.04 

3.07 

J.B9 

33.6 

21 

31 

.01 

6.31 

1.9* 

33.6 

21 

31 

.04 

Ratings 

Four  different  types  of  ratings  have  been  tried  out  with  fighter  pilot3  in 
the  Continental  Air  Forces;  ratings  with  a  printed  form,  ratings  secured 
through  personal  interviews  with  instructors,  and  rankings  t  made  by  in¬ 
structors  and  rankings  by  fellow  students  on  each  other.  The  first  two 
types  were  secured  in  the  First  Air  Force  and  the  latter  two  in  the  Second 
Air  Force.  The  correlation  of  stanines  with  ratings  on  the  printed  form  are 
presented  in  table  2.40.  In  May  1945  ratings  on  the  printed  rating  form 
were  discontinued  in  the  advanced  phase  of  training  in  the  First  Air  Force 
and  the  ratings  secured  by  interviews  with  instructors  substituted  fer  them. 


Table  2.40.— Relation  of  pilot  stanine  to  proficiency  ratings  i  <  operational  training 

P-47  PILOTS— FIRST  AIR  FORCE 
Correlation*  between  pilot  stanine  and: 


Type  of  rating 

N 

Gunnery 

items 

Fly  leg 
item* 

Trait 

items 

3  H 
« 

475 

461 

427 

mrm 

1 ml 

•0.12 

03 

Printed  rating,  advanced  stations . 

•0.11 

•*0.19 

mBm 

The  relation  of  p^ot  stanine  to  this  type  of  proficiency  rating  is  also  shows 
is  table  2>0  for  a  total  of  four  commitments. 

The  results  of  validity  studies  of  rankings  by  instructors  and  by  feOow 
students  in  the  Second  Air  Force  are  shown  In  table  2.41. 


Taj  LX  2.41 . — Correlations  b  tioetn  augmented  pilot  stanine  end  nnUngs  by 
instructors  end  feOow  Undents 
r-ti  p;  lots— second  air  rotes 
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Flying  Evaluation  Board  Reports 

Among  possible  criteria  of  fiying  proficiency,  appearance  before  a  Fly¬ 
ing  Evaluation  Board  because  of  official  reports  of  professional  incom¬ 
petence  would  logically  be  expected  to  indicate  a  low  degree  of  proficiency. 
Whether  because  very  few  men  entering  the  training  air  forces  were  in¬ 
efficient  fliers  or  whether  officials  were  loath  to  remove  a  man  from  flying 
at  this  stage  of  the  game,  the  fact  was  that  relatively  few  student  officers 
were  ever  brought  before  Flying  Evaluation  Boards.  Three  studies  are 
reported  here.  Because  of  the  small  number  of  trainees  re-evaluated,  what 
little  relationship  was  found  between  stanine  and  re-evaluation  is  not  be¬ 
lieved  to  be  of  much  practical  importance. 

In  table  2.42  are  shown  stanine  comparisons  for  three  groups  of  pilots 
appearing  before  Flying  Evaluation  Boards.  This  table  includes  all  men 
on  whom  stanines  could  be  found  that  met  the  First  Air  Force  Flying 
Evaluation  Boards  between  April  1944  and  July  1945. 


Table  2.42. — Stanine  comparisons  for  three  groups  of  pilots  appearing' 
before  flying  evaluation  boards 
NONPHYSICAL  REASONS  ONLY — FIRST  AIR  FORCE 


Statistic* 

FVia* 

deficiency 

PosonaKty 

Vtkaowm 

Al 

20 

15 

12 

47 

m  itwtr.  . 

6.19 

6.54 

6.25 

4.25 

M  (obtained) . 

5.60 

6.27 

5.92 

S.Jt 

s.  D.  (obtained)  . . . ! . . . . . . . . . . .  .. .. . . . . . . . . . 

t  .S3 

1.49 

0.90 

1.51 

S.  E.  (obtained  M) . 

.42 

.40 

.27 

.22 

For  comparison  purposes  it  wns  assumed  that  the  populations  of  pilots 
entering  the  First  Air  Force  for  operalional  training  were  random  samples 
of  pilots  graduating  from  advanced  schools  in  the  AAF  Training  Command. 
A  theoretical  mean  stanine  of  these  population:;  was  obtained  by  weight- 
in?  the  mean  stanine  for  each  Trair/ng  Command  class  according  to  the 
proportions  of  that  class  found  in  .he  Flying  Evaluation  Board  group. 
Comparisons  were  then  made  between  the  theoreuca!  and  obtained  mean 
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rfiihn  b  tafck  142  it  caa  be  acts  tbt  al  grave  of  re-evaluate/  pl« 
bad  lower  ataabcs  tba  the  theoretical  m»  of  their  pcpahsiM,  <h* 
bdog  parriniiriy  tree  of  the  mtm  who  act  the  Board  breae  of  fiyfcg 
drldncki  Though  the  ■trafcrri  hwhd  are  too  ml  to  warrant  the 
am  of  critics!  ratios,  the  obtained  afaata  caa  be  roughly  evaluate* 
hi  terns  U  the  data  gbea  ia  the  table. 

la  the  Second  Air  Force,  of  a  total  of  790  fighter  pilots  ia  the  May  aid 
Jane  1944  ra—teaeats  in  the  72d  Fighter  Wing,  31  were  ifrcwhated  b j 
Flying  Evaluation  Board  action.  Another  127  had  aircraft  accidents,  k» 
lag  632  pilots  whose  records  show  they  might  be  thought  at  kast  moderate^ 
saooessfal  ia  tufawg  The  biserial  coefficient  of  cocrdatioa  between  pht 
stanine  and  success  or  failure  ia  training,  as  evidenced  by 
through  FEB  actio,  was  0J09. 

Ic  the  Fourth  Air  Force  the  stanrnrs  of  1894  P-38  fighter  pilot  trainees 
were  studied  in  relation  to  re-evaluation.  It  was  found  that  the  lower  the 


Tuts  lM.—Mlmtiom  k* worn  plot  Ombta  ml  rmtimtin  rate 
fopeth  Ata  rates  Mt  nuns 
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room  ua  rates  mi  nuns 


UUow 

N 

SEW 

rnkUtr 

HhOmniMt . 

|f 

4  It 

1  ft 

}  O.U 

arfmllirSSraetar . 

27 

*.«7 

1.7* 

wimne,  the  greater  the  chances  were  that  die  trainee  would  be  re-evaluated. 
The  re-evaluation  rate  of  the  low  stanine  trainees  was  more  than  twice 
that  of  the  high  stanine  trainees.  These  results  are  shown  in  table  2.43. 
The  relationship  between  pQot  stanine  and  initial  cause  of  referral  to  the 
Flying  Evaluation  Board  is  shown  in  table  2.44. 

Accident* 

One  of  the  most  useful  functions  that  the  psychological  program  could 
perform  would  be  to  identify,  and  eliminate  from  training,  accident  prone 
individuals.  Consequently,  research  personnel  in  all  four  of  the  Con¬ 
tinental  Air  Forces  devoted  a  considerable  amount  of  time  studying  and 
analysing  accident  records  and  correlating  various  accident  factors  with 
aptitude  scores. 

In  the  First  Air  Force  the  relationship  between  accidents  and  st&nines 
are  shown  in  tables  2.45  and  2.46.  The  accident  group  was  matched  with 
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%  cantrol  noo-acddent  population  fez:  (1)  GraduiJoa  from  the  one 
'Training  Command  das?.  (2)  Contemporary  attendance  at  same  bade  and 
^jvaoced  stathm.  (3)  Amount  of  flying  experience.  (4)  Officer  status  in 
the  Training  Command  (student  offices  or  enlisted  aviation  cadets). 

gxaminatioo  of  the  data  in  table  2.45  indicates  that  there  was  a  signifi- 
aot  (P<0.05)  difference  between  pilot  stanines  of  pilots  having  accidents 
(afl  causes)  and  pilots  in  s  control  group  (no  accidents)  and  between  pilots 
baying  accidents  classified  as  caused  by  pilot  error  and  pilots  in  the  coo» 


f.mrw  2.45. — Jtdotion  of  fOot  stenbu  to  aircraft  oedients  im  notions  categories 

fust  ah  roacs 
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4.25 
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1.40 

19 

5.58 
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23 

4.12 

1.44 
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4.27 

1.40 

10 

4.50 

1.13 

^  .  . 

13 

4.15 

1.2* 

18$ 

4.24 

».a» 

38 

6.13 

1.48 

1* 

4.24 

II.l 

19 

4.11 

l.W 

1 

T*w  2.46. — Distribution  by  zUume  of  accident-free  control 
and  pilot-error  accident  pilots 


SUniac 

Acddcnt-fre*  control 

N 

Percent 
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29 
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■3 

t.n 

26 

12.75 

■j 

15.40 

45 

22.06 

40 

10.41 

54 

26.47 

44 

22.51 

33 

16.17 

43 
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13 

6.37 

K2 

^■1 

1.47 
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•4& 
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■  — 1 

204 
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! _ !_  ' 

trol  group.  None  of  the  other  differences  between  the  stanines  of  the 
various  groups  was  significant. 

For  the  May  and  June  commitments  in  the  Second  Air  Force,  the  p&ot 
stanines  (with  criteria)  of  127  fighter  pilots  (P-47)  who  had  had  acci¬ 
dents  were  compared  with  the  pilot  stanines  of  632  men  who  completed 
training  without  difficulty.  The  biserial  correlation  between  stanines  and 

accidents  for  the  two  groups  was  0.09.** 

Further  data  on  Second  Air  Force  fighter  pilot  accidents  we\e  available 
from  a  study  of  a*rcraft  accidents  of  pilots  in  training  from  July  1944  to  1 
January  1945.  During  this  period,  342  fighter  pilot  trainees  had  aircraft 

accidents  for  287  of  whom  stanines  were  found  to  be  available.  Compari- 

rr of  these  Dilots  and 

■  - -•  • 
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tin  am  dminf*  j>(  tiro  groups  of  controls  without  accidents  showed  g 
fnui)  difference  in  favor  of  the  control  groups.  In  table  2.47  are  shows 
separate  comparisons  between  the  stanines  of  pilots  with  various  categories 
of  accidents  for  pilots  in  the  corresponding  control  groups.  Control 
Group  A  represented  pilots  graduating  from  advanced  schools  at  the  same 
time  and  Control  Group  B  represented  a  random  group  of  single-engine 
■  pilots  in  the  Second  Air  Force  at  the  time  of  the  accidents. 

In  a  preliminary  study  in  the  Third  Air  Force  the  stanines  of  fighte* 
pilots  having  aircraft  accidents  during  the  2-month  periods  were  compared 
with  stanines  of  pilots  in  corresponding  control  groups.  The  contradictory 
results  obtained  in  the  two  samples  showed  the  importance  of  obtaining 
large  samples  and  of  controlling  as  many  as  possible  of  the  factors  involved. 
The  results  of  n  more  extensive  study  in  the  Third  Air  Force  are  shown  ia 
table  2.48.  Data  were  collected  for  all  fighter  aircraft  accidents  occurring 


Tabu  2.41.— Comparison  of  stonbut  of  pilots  with  akraft  Occidents  m 4 
stonbiss  of  two  control  groups 

P-47  AND  P-40  PILOTS — SECOND  All  FOKCS 


Orisfeofacckfeat* 
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Group  A 
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Group  B 
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03 

B3 

an 

flktm  .  . 
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4.65 
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6.67 

1.41 

bfataftot  ud  oBanaihbk . 

94 

6.« 

1.59 

6.16 

1.60 

6.70 

1.45 

Hi  difarwc*.'  betweea  accident  pilot*  tad  pQott  ia  Control  Group  B  arc  dsnificaat  at  (ha  W 
pNcaat  total  far  accident*  doc  to  oakaotm  and  mttfricl  and  unavoidable  reason*  and  at  (be  1  pareatf 
total  lor  accident*  <oa  to  pitot  ante. 


between  1  Jut-  1944  and  1  May  1945.  The  names  of  several  thousand 
pilots  trained  in  the  Third  Air  Force  during  this  same  period  were  obtained 
from  the  Air  Force  Personnel  Depots.  From  these  names  were  chosen  a 
control  jfoup  in  which  date  of  training  in  the  Air  Force,  Psychological 
Ur!'  at  which  classification  was  carried  out,  and  date  of  testing  were  con- 

oiled.  Comparisons  were  made  between  the  mean  bombardier,  navigator, 
pilot  and  pilot  plus  credit  stanines  for  pilots  having  accidents  ascribed  to 
pilot  error,  accidents  ascribed  to  materiel  failure,  accidents  of  causes  un¬ 
determined,  and  stanines  of  the  control  group  of  phots  who  had  no  aircraft 
accidents  k  operational  training.  As  shown  in  the  table,  the  differences 
were  not  large,  but  pilots  with  accidents  ascribed  to  pilot  error  consistently 
had  lower  stanines  than  pilots  of  the  control  group  or  pilots  who  had  acci¬ 
dents  ascribed  to  materiel  failure.  These  differences  are  significant  at  ap¬ 
proximately  the  10  percent  leveL 

In  the  Fourth  Air  Force,  accident  data  were  collected  m  1880  P-58 
trainees,  all  of  whom  were  in  training  during  the  last  half  oi  1944  and  the 
first  quarter  of  1945.  A  total  of  280  trainees  in  this  group  had  one  or 
more  accidents.  Comparisons  were  made  between  the  pilot  stanines  of  the 
accident  free  group  and  those  of  groups  of  pilots  having  various  types  of 
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accident*.  These  da U  are  presented  in  table  2.49.  While  the  differences 
^  pot  great,  accident  groups  of  all  types  except  those  for  which  the  acd- 
^  cause  was  unknown  have  lower  mean  pilot  stanioes  than  the 
free  group. 

Time  Required  to  Complete  Trehdmg 

Individual  stations  in  the  Continental  Air  Forces  have  probably  bees 
more  flexible  in  handling  their  training  directives  than  have  the 
and  schools  in  the  Training  Command.  Student  officers  are  relatively  on 
their  own  in  completing  the  necessary  fighter  pilot  requirements  in  opera¬ 
tional  training,  and  individuals  within  each  commitment  thus  have 
opportunity  to  finish  the  complete  course  of  instruction  in  different  length* 
of  time.  A  possible  indication  of  individual  differences  in  proficiency  would 

Tans  2 M.~ Comparison  of  stanines  of  fighter  pilots  with  various  typos 
of  ainroft  accidents  and.  stanines  of  a  control  group 
THIRD  AIR  FORCE 


PSots  with  acddeats  h: 


Type  of  tunae 


octroi  pilot* 


Keen  (  Sl  V.  I  Mm 


be  the  number  of  weeks  or  months  required  to  complete  such  training. 
An  exploratory  study  was  done  in  the  First  Air  Force  of  the  relationship 
between  stanine  and  time  in  months  to  complete  training.  Tbe  correlation 
between  pilot  stanine  and  time  taken  to  complete  basic  training  was  0.16.* 
That  between  pilot  stanine  and  time  taken  to  complete  advanced  training 
was  0.13.  For  total  training  (basic  plus  advanced)  tbe  correlation  with 
pflot  stanine  was  0.21.**  Tbe  coefficients  for  basic  and  for  total  training 
were  based  on  data  for  <01  pilots  while  that  for  advanced  training  included 
144  pilots. 

Exploratory  studies  were  also  carried  out  in  the  Second  Air  Force  to 
determine  Je  relation  between  training  accomplishment  and  tbe  pilot 
stamnes  of  fighter  pilots  in  operational  training.  For  the  25  pilots  in  the 
2-28-45  class  at  Peterson  Field  it  was  found  that  the  correlation  between 
star-mes  and  number  of  requirements  completed  at  the  end  of  eight  weeks 
0.21,  that  the  correlation  between  stanines  and  hours  flown  in  opera¬ 
tional  training  was  —0.09,  and  that  the  correlation  between  stanines  and 
cumber  of  requirements  completed  per  hour  flown  was  0.42.  On  the  basis 
01  these  encouraging  results,  a  study  was  made  of  the  December  1944  com¬ 
mitment  of  fighter  pilots  trained  at  three  7  2d  Wing  stations.  Three  scores 
representing  training  accomplished  at  the  end  of  5  weeks  weie  obtained 
for  each  of  tbe  75  pilots  involved.  These  scores  were  the  weighted  number 


Distributions  of  pilot  stanhus  by  eouso,  number,  ond  result  of 
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0f  tnissions  reported  (t be  first  mission  of  a  particular  type  was  wtlghtes 
Bore  heavily  repetitions  of  that  mission),  the  hours  flown  in  opera* 
tional  training,  and  the  number  of  AAF  Training  Standards  completed. 
Correlations  between  these  scores  and  the  stanines  of  the  pilots  are  shown 
In  table  2.50.  These  coefficients  represent  the  z  average  of  the  separate 
coefficients  for  each  class  and  station.  In  contrast  to  the  results  obtained  la 
ix,«  earlier  study,  the  hours  flown  showed  the  greatest  correlation  with  the 
pOotstanine. 

Table  230. — Correlations  between  stanines  and  trahunp  accomplished* 

75  P-47  PILOTS— SECOND  AIK  FORCE 
All  (UtloM  combined 
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.05 

.18 
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6.32 

6.48 

6.67 

1.9 

l.S 

l.S 

1.7 

•Obtained  by  Iyer’s  s  technique. 

In  interpreting  the  results  from  both  Air  Forces.,  mention  should  be  made 
of  the  many  variables  such  as  weather,  illness,  maintenance  and  training 
irregularities  which  obviously  influenced  these  scores.  However,  without 
denying  that  they  are  important,  it  is  still  difficult  to  see  how  such  un¬ 
controlled  variables  could  have  produced  a  spurious  validity.  Rather,  it  is 
surprising  that  statistically  significant  coefficients  of  validity  are  obtained 
at  all  when  such  factors  were  operating  to  an  unknown  extent 

Academic  Grades 

Research  personnel  of  the  Second  Air  Force  were  asked  to  assist  in  the 
evaluation  of  a  fighter  pilot  proficiency  test  given  in  the  7  2d  Fighte*  Wing. 
Data  were  available  for  a  preliminary  administration  of  the  test  to  46 
student  pilots  at  2  stations.  The  correlations  between  the  raw  scores  for 
each  part  and  the  total  test  and  the  stanines  of  the  40  pilots  for  whom 
stanines  were  available  are  given  in  table  2.51. 

Table  2.51. — Correlations  between  stwines  and  written  proficre^y  test  scores 

46  P-47  PILOTS— SECOND  AIR  FORCE  _ 
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Quite  aa  extensive  study  his  been  made  on  the  relationship  between 
sUnines  and  various  ground  school  grades  of  P-35  pilots  in  the  Fourth  Air 
Force.  These  results  are  presented  in  table  2.52. 


Tuu  2J2—CorrtUtions  between  ttenbuj  end  Mrint  ground  school  ptiu 
r-st  PILOTS— FOCATH  AIK  rotes 


Retention  as  Instructor 

At  the  completion  of  their  training  a  number  of  the  fighter  pilots  in  the 
First  Air  Force  were  retained  as  instructors  for  varying  periods  of  tssoe. 
Stanines  were  found  for  209  of  these.  In  order  to  determine  the  extent 
to  which  the  pilot  stanine  was  predictive  of  retention  as  instructor,  tin 
average  stanine  of  these  pilots  was  compared  with  the  theoretical  average 
stanir-'j  of  a  corresponding  up  of  unselected  pilots.  The  two  averages 
r.cic  6.46  and  6.05  vespecti  for  instructors  and  unselected  pilots.  The 
theoretical  stanine  for  the  corresponding  unselected  group  of  pilots  was  ob¬ 
tained  by  computing  a  weighted  average  of  the  mean  stanines  of  the  ad¬ 
vanced  dying  school  classes  of  which  these  pilots  were  a  part  This  type  of 
control  k.  based  npon  the  assumption  that  pilots  entering  operational  trail¬ 
ing  in  the  rust  All  Force  arc  an  unselected  sample  of  pilots  graduating  from 
advanced  su  :-ois. 

Validation  of  Stanines  Against  Combinations  o!  Criteria 
Examination  of  the  nature  of  various  types  of  aiterion  scores,  the  low 
intercorrektions  obtained  between  such  scores  and  the  opinions  of  super¬ 
visory  personnel  and  officers  returned  from  combat  all  lecd  to  the  conclusion 
that  no  single  measure  would  adequately  cover  all  aspects  of  combat  flying. 
Although  it  is  probably  true  that  the  ultimate  aim  of  operational  training 
was  to  enable  the  fighter  pilot  to  hit  a  moving  or  stationary  target,  it  was 
also  believed  important  that  \he  pilot  be  able  to  fly  dose  formation,  that 
he  excel  in  "rat  races,"  that  he  have  no  fear  of  flying  "on  the  deck,” 
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that  be  be  able  to  navigate  with  accuracy,  etc  It  b  certain  that  the  degree 
of  proficiency  shown  in  many  of  these  activities  would  be  highly  correlated; 
but  in  the  absence  of  accurate  measures  of  such  proficiencies  It  is  impossible 
to  determine  at  this  time  the  degree  to  which  they  are  related.  In  addition, 
the  unreliability  of  such  measures  as  are  available  makes  It  difficult  to 
interpret  the  intercorrelations  between  them.  Hence  it  seemed  desirable 
to  try  out  various  combinations  of  criteria  In  validation  studies  although 
the  optimum  combination  for  this  purpose  was  not  known. 

A  number  of  studies  of  combined  criteria  were  carried  out  in  the  Fir  it 
Air  Force.  In  the  preliminary  study  a  standard-score  method  of  combining 
criteria  was  used  with  the  May  and  June  1944  commitments.  Aerial  ginn¬ 
ery  scores,  ground  gunnery  scores,  printed  proficiency  ratings  from  bade 
training  stations,  and  proficiency  ratings  secured  from  interviews  with  in¬ 
structors  at  advanced  training  stations  were  combined  into  a  total  profi¬ 
ciency  score.  The  correlations  between  the  pilot  sianines  and  the  combined 
criterion  scores  are  shown  by  station  and  commitment  in  table  2.53. 


Tabli  2.53. — Correlations  o'  combined  criterion  scores  with  piot  stoning 
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Another  way  of  expressing  the  relationship  between  pilot  stanine  and 
proficiency  is  to  give  the  mean  pilot  stanine  of  groups  of  pilots  of  different 
levels  of  proficiency.  From  the  distributions  of  the  composite  criterion 
scores  for  the  pilots  in  tire  May  and  June  1944  commitments,  the  high  and 
low  group  were  selected  by  using  as  cut-off  points  one  sigma  distance  above 
and  below  the  means  of  the  distributions.  For  the  resulting  high,  middle, 
and.  low  groups  in  each  distribution  the  mean  bombardier,  navigator  and 
pilot  stanines  were  found.  The  combined  results  for  the  two  commitments 
are  shown  ia  table  *.54. 

A  further  study  was  done  in  the  First  Air  Force  in  which  an  attempt  was 
made  to  make  the  composite  score  include  a  still  wider  coverage  of  criteria 
of  proficiency  in  operational  training.  In  this  connection,  to  save  time  and 
effort  in  connection  with  studies  of  individual  test  validities,  it  had  been 
decided  to  carry  out  the  initial  validation  of  tests  and  stanines  against 
smaller  groups  at  the  extremes  of  proficiency.  The  reasons  for  this  decision 
are  given  in  more  detail  in  the  section  on  Test  Validation.  However,  since 
such  groupings  were  being  made  for  Cae  test  validation,  stanine  validities 
were  also  obtained  on  this  basis. 
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The  extreme  high  and  low  groups  (or  the  May,  June,  July,  and  August 
1944  commitments  were  selected  in  the  following  manner:  The  high  group 
was  composed  of  all  individuals  who  feQ  one-half  sigma  above  the  meaa 
on  the  combined  ground-aerial  gunnery  score  and  who  were  at  least  above 
the  mean  on  the  verbal  interviews.  From  this  group  were  eliminated  a| 
men  who  fell  one  and  one-half  sigma  below  the  mean  on  the  bask  prog, 
tiency  rating  scale  and  the  mission  card  comment  scores,  or  who  had  be** 
re-evaluated,  or  who  had  had  an  accident  due  to  personnel  failure.  The 
low  group  was  composed  of  all  individuals  who  fell  one  and  one-half  sigma 
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below  the  mean  on  the  combined  ground-aerial  gunnery  scores  and  who 
were  also  below  the  mean  on  the  ve  rbal  proficiency  rating.  (In  gunnery 
the  cut  off  points  for  the  high  and  low  groups  are  not  symmetrical  riiyy  the 
distributions  are  markedly  skewed  in  tbe  direction  of  poor  scores).  From 
this  group  were  excluded  any  individual  Vno  ^as  one  and  one-half  sigma 
above  the  mean  on  the  basic  rating  scale  ?.nd/i/  the  mission  card  com¬ 
ment  score.  The  number  in  the  high,  middle,  and  lev  groups,  the  mean 
pOot  stanine  and  standard  deviation  for  each  group  a  .  a  the  triserial  cor¬ 
relation  between  various  groups  and  pilot  stanine  are  sL\-u  in  table  2.55. 
The  critical  ratios  of  the  differences  between  the  stanines  ./  each  group 
are  also  shown  in  the  table. 

In  the  Second  Air  Force  pilots  suffering  aircraft  accidents  a*.'  those 
eliminated  from  training  by  Flying  Evaluation  Board  action  were  gro.-.^j 
together  as  a  failure  group  in  a  study  ci  stanine  validity.  The  success  group  " 
included  all  pilots  without  accidents  or  re-evaluation.  The  biserial  co- 


Table  2,55. — Relationship  of  pilot  stanine  to  kith-low  proficiency  grouping* 
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efficients  of  correlation  between  pilot  stanine  (with  credit)  and  success  or 
failure  in  operational  training  is  given  in  table  2.56  for  pilots  in  the  May 
end  June  1944  commitments.  Also  shown  are  the  separate  validity  CO* 
efficients  (biserial)  for  accidents  and  Flying  Evaluation  Board  action  alone. 


Tabu  2.56. — Correlation  of  pilot  stanine  with  mitt  it  ixi  ftS wrt 
in  operational  training 
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In  the  Fourth  Air  Force  the  stanines  of  P-38  and  P-39  fighter  pilots  of 
five  categories  of  proficiency  were  compared.  The  five  categories  used  rep* 
resented  various  combinations  of  aircraft  accidents  and  elimination  by  Fly¬ 
ing  Evaluation  Board  action.  Thjs  study  was  based  upon  the  records  of 
all  second  lieutenants  and  flight 'officers  in  fighter  pilot  training  in  the 
Fourth  Air  Force  from  1  January  through  November  1944  for  whom 
stanines  were  available.  The  average  stanines  of  pilots  in  the  five  groups 
are  shown  in  table  2.57.  It  is  apparent  from  the  table  that  when  the  cate¬ 
gories  are  arranged  in  a  logical  order  from  greatest  to  least  proficiency,  the 
average  pilot  stanine  shows  a  similar  progressive  decrease  with  pilots  in  the 
least  proficient  category  showing  the  lowest  average  pilot  stanine. 

The  combination  of  two  or  more  types  of  proficiency  scores  as  a  criterion 
against  which  to  validate  selection  procedures  has  the  logical  advantage  of 
providing  better  coverage  of  the  total  job  of  the  combat  pilot.  Although 
it  does  not  of  necessity  follow,  one  would  rather  expect  such  a  combined 
criterion  to  result  in  higher  validity  coefficients  than  were  obtained  with 
particular  proficiency  measures  when  a  general  flying  aptitude  score  such 
as  the  pilot  stanine  is  studied.  The  data  reported  here  on  stanine  validities 
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Tabu  2.57. — Mean  stanines  of  pilots  of  different  categories  of  proficiency 
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against  combinations  o!  criteria  do  not  support  such  as  expectation.  pw 
example  In  table  2.53  the  correlation  between  a  combination  of  aerial  aa| 
ground  gunnery  scores,  ratings  at  basic  schools  and  interview  ratings  at 
advanced  schools  yielded  a  validity  coefficient  of  0.23  for  approximately 
200  pilots.  For  the  same  pilots  (May  and  June  commitments  only)  t be 
validity  of  the  advanced  ratings  alone  was  0.26.  The  0.02  advantage  Us 
the  combined  criterion  hardly  warrants  the  extra  computations  involved. 
When  still  wider  coverage  of  criteria  was  attempted  as  in  table  2.55,  the 
validity  coefficient  was  0.20  while  that  for  the  advanced  school  rating) 
alone  on  C~*  same  groups  of  pilots  was  .19  (table  2.40).  Of  course  the 
interpretation  d  the  data  in  table  2.55  is  complicated  by  the  fact  that  a  tri¬ 
serial  coefficient  was  used.  However,  there  is  certainly  no  dear  evidence 
of  any  great  superiority  of  the  combined  criteria.  Similarly  the  combina¬ 
tion  of  acddents  and  Flying  Evaluation  Board  eliminations  in  table  2J57 
raised  the  validity  of  the  pilot  stanine  0.01  from  that  obtained  with  each 
criterion  separately.  Insufficient  data  are  available  to  determine  whether 
or  not  this  outcome  is  due  to  a  high  degree  of  intercorrdation  between 
criteria  or  to  other  factors  not  yet  recognized. 

Miscellaneous  Validation  * 

Had  they  been  available  for  study,  a  number  of  scores  and  ratings  given 
pilots  in  the  AAF  Training  Command  could  have  been  studied  in  relation 
to  criteria  of  profidency  in  operational  training.  For  fighter  pilots  the 
only  data  of  this  type  studied  in  the  continental  dr  forces  were  the  fixed 
gunnery  scores  in  the  AAF  Training  Command.  Data  were  available  for 
179  P-47  pilots  in  the  First  Air  Force.  The  correlation  between  fixed  gun¬ 
nery  scores  in  the  AAF  Training  Command  and  scores  in  aerial  and  ground 
gunnery  in  operational  training  were  0.24  and  0.12  respectively.  The  cor¬ 
relation  with  the  combined  aerial  and  ground  gunnery  scores  was  0.38. 
Although  the  number  of  cases  is  small,  these  coeffidents  loricate  that  gun¬ 
nery  performance  in  the  Training  Command  is  more  dost:/  related  to 
gunnery  performance  in  operational  training  than  are  stanines  o.;d  clas¬ 
sification  test  scores. 

Teat  Validation  . 

The  relative  effectiveness  with  which  various  criterion  scores  were  pre¬ 
dicted  by  the  different  dassification  tests  is  shown  in  tables  2.58  through 
2.70  which  follow.  Data  on  the  prediction  of  air-to-air  gunnery  scores  am 
given  for  three  groups  of  pilots:  P-38,  P-47  and  P-61  pilots  in  tables 
2.53 — 2.60.  Correlations  between  test  scores  and  air-to-ground  gunnery 
scores  for  P-38  and  P-61  pilots  are  given  in  table  2.61  and  2.62.  The  rda- 
tion  between  test  scores  of  P-38  pilots  and  skip  bombing  scores,  dive  bomb¬ 
ing  scores,  mi  sion  grades,  adversity  scores  and  Flying  Evaluation  Board 
action  are  shovn  in  tables  2.63 — 2.67.  Finally,  the  degree  of  prediction  of 
acddents  by  tl  ?  test  scores  is  shown  in  tables  2.68  and  2.69  for  P-^38  and 
P-61  pilots.  The  tables  for  P-35  pilots  represents  all  available  data  on 
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pilots  trained  in  the  Fourth  Air  Force  the  last  half  of  1944  and  the  first 
kalf  of  1945. 
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Tajik  2.59. — Correlations  between  test  scores  (*)  and 
air-to-air  gunnery  scores  (7) 
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8.88 

6.45 

246 

-.10 

Kcmerical  nj*r.t^n.  TT  rtiffiB . 

30.77 

11.33 

8.8S 

6.49 

246 

-.1* 

Mathematia  A  Cl  702E . 

27.76 

17.30 

8.73 

8.04 

102 

.00 

Ha  thematic*  *  r  f  trrijF  . 

23.86 

14.78 

8.91 

*.37 

255 

.04 

Mathematic*  3  Cl  7tOA . 

38.68 

15.93 

7.97 

7.45 

9! 

.18 

Mathematic*  B  Cl  20AC  . 

16.46 

9.09 

9. 08 

6.53 

257 

-.01 

B:ojriphic4l  d*tA  (P)  CE  602 D . . . 

30.00 

6.17 

9.0* 

6.45 

257 

-.00 

E*ogr»bWcml  dat*  CE  602D . . . 

22.57 

3.13 

9.08 

6.45 

2ST 

-.00 

Speed  of  identification  CP  610A . 

46.91 

4.39 

8.63 

6.7* 

337 

.08 

General  information  (N)  PR  MMT» . 

20.94 

5.29 

8.88 

5.49 

246 

.06 

teacrtl  iafonnition  fpi  CE  SOMD . 

37.17 

6.21 

8.88 

6.49 

246 

.01 

general  information  t.R  st»E . 

52.90 

li.65 

13.65 

2.64 

11 

.19 

Technical  vocabulary  (?)  CE  505C . 

20.50 

7.56 

8.73 

8.04 

102 

.01 

Technical  Voeahnlary  (B)  CE  S05C . 

5.67 

3.23 

8.75 

1.04 

102 

•06 

Technical  vocebulary  CN)  CE  505C .  . 

15.27 

£.46 

1.73 

i.  04 

102 

-.0* 

05c«  Quality  '  . . . 

45.75 

8.76 

8.73 

6.5! 

251 

.01 

- _ 

..... 

- - 

703350— 47--* 


4 
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t 

1  .* 

Tiu  iML—ComUtiomi  trtwa  stooima  «W  M  iwro  (i)  h< 
air-s»  sir  Gmaery  Serna  (y) 


mi  mois-foami  ah  roses 


D 

SOW 

D 

sow 

n 

s 

».« 

9  *7 

4.24 

1.72 

2*4 

.0 

Mafmtmmmlm . 

SO.SO 

49.66 

9*7 

9.47 

4.21 

4.19 

1.90 

1.41 

244 

244 

-5 

iBaqriMSCK  MOA_ . . . 

An 

9.44 

22.22 

*22 

195 

M 

t—  Mn.rh.i«oma. . 

a.  so 

9.12 

22.24 

3. *.40 

197 

M 

M.M 

9.S7 

22.14 

»e.r? 

2*4 

•  || 

C.S7 

22.4C 

4.15 

244 

.» 

49.56 

9.12 

54.92 

9.76 

242 

.44 

SO.  IS 

9.22 

41.42 

M.  12 

197 

If 

SO.  14 

9.44 

29.94 

4  41 

10 

.44 

49. 14 

9.44 

12.79 

9.20 

449 

.44 

49.14 

9.44 

5.77 

2.24 

149 

.41 

49.73 

9.21 

17.42 

2.42 

5*3 

.41 

49.14 

9.44 

29.92 

17.12 

149 

.44 

i!.*S 

10.92 

22.44 

14.45 

52 

.•1 

49.20 

1.95 

41.19 

14.97 

127 

Ml 

Sl.tS 

19.92 

19.02 

9.74 

52 

.It 

.n 

49.73 

9.22 

23.99 

12.14 

192 

Mshamcal  iinui  C19C1A . . __ . 

49.72 

9.22 

42.74 

12.84 

192 

M4 

49.20 

1.42 

15.12 

7.4* 

127 

.19 

Dal  u4  table  m£w  CT*21-22A  . . 

Knaia!  ntunf  um  1  C17WI . . . 

49.72 

9.22 

*4.49 

4.91 

192 

M4 

49.66 

9.17 

17.19 

2.99 

204 

.m 

rr— rrir«l  epi  nrii— Tl  r~|HT . 

49.44 

9.B7 

15.94 

2.24 

204 

.m 

Spatial  eriratatio.  I CKKS . 

49.44 

9.97 

29.12 

12.55 

204 

■  -  m 

Sptfiii  orieatatioa  U  CP3BIB . 

49.44 

9.97 

2J.94 

4.22 

204 

.so 

21.02 

21.02 

10. « 

57.55 

5.4c 

SS 

-.14 

•-.» 

Cacnl  ■fa-naliw  (X)  CXM8D . 

10.92 

22.94 

4.79 

25 

• 

21.44 

9.9C 

47.45 

L  ■  . 

9.92 

34 

-.11 

* 


<» 

Tabu  2j61. — CornU^umi  (dven  sUadtui  and  tat  tecta  (x)  smd 
ar-to-pomi  pbsmery  scorn  (y)  ^ 

F-3i  mors— roerra  Air.  roses  { 


PieSctor  variabka 

M, 

SD, 

D 

n 

- «£—  f-TlTTirT 

2.99 

1.78 

49.92 

'  9.6» 

1274 

•*.« 

Ni«il>t*rMnt . 

5.7) 

1.86 

49.92 

9.64 

1274 

*.« 

NmtuiH . 

5.97 

1.60 

49.92 

r  9  64 

1274 

Kotaiypanait  CM«2A . 

22.74 

9.48 

\f.7: 

'9.28 

659 

i 

Two  kaad  cocrdinatioa  CZA101A . 

53.57 

*\4V 

50.04 

9.54 

1736 

SiIkS)  •_ 

S3. 20 

9.55 

49.92 

f  .66 

1273 

4  *.ZZ 

w.6S 

50.04 

9.54 

1236 

Discrimination  reaction  time  CP411D . - 

54.18 

8.73 

49.91 

9.64 

1274 

Tracer  dexterity  CM1I4A . 

21.11 

9.75 

49.92 

9.64 

1274 

lnlit  BPnktsai  C1414G . 

23.34 

12.79 

50.04 

9.54 

1236 

Mechanical  principles  Cl 903 A . 

62.02 

17.77 

50.04 

9.54 

1236 

M*eh  ..lr«l  laiodcstxa  Cl 405 A . 

15.70 

7.91 

*9.52 

9.04 

586 

Dill  and  table  rta^inf  CP622-21A . 

35.78 

1.27 

49.92 

9.64 

1274 

iAiiiBf'! 

Spatial  orientation  I!  CPS03B . . . 

22. 80 

6.7C 

49.92 

9.64 

1274 

Spitifti  orkatAiioo  I  CP50SB . 

28.61 

5.74 

49.92 

9.64 

1274 

.91 

Numerical  operations  {1-3  C1702B . 

35.01 

11.78 

49.92 

9.64 

1274 

.02 

Numerical  operations  (b)  Ci)02B . 

32.21 

11.37 

49.92 

9.64 

1274 

.02 

Mathematics  A  C1T02E  . 

22.75 

17.20 

49.32 

9.19 

624 

».0I 

Mathematic*  A  C1702F . 

24.78 

16. 12 

50.50 

10.00 

650 

.05 

Mathematics  B  C1710A  . 

38.80 

15.67 

49.32 

9.19 

624 

.05 

15.74 

*  33 

50.50 

10  00 

650 

.05 

diocraphictJ  daU  {P»  CL6 02D  . ~  •  -  •  -  ^ . 

29.15 

6.28 

50.36 

26.02 

595 

.01 

Biojrsphical  data  (N)  CE402D  . 

22.47 

3.17 

50.36 

10.02 

595 

-,0J 

Speed  oi  identification  CF61CA  . 

34.21 

7.28 

49.92 

9.64 

1274 

.01 

General  imonnation  (N)  t  tMJJLi . 

21.05 

5.41 

50.50 

10.00 

650 

.04 

G*n<r*J  infonpatioc.  ( P )  CE505D  . 

36.15 

6.03 

50.50 

10.00 

650 

.02 

Technical  vocabulary  (P)  CE50SC . 

21.07 

6.59 

<9.32 

9.19 

624 

.0* 

Technical  vocabulary  lb)  CE503C  . 

5.51 

3.11 

49.32 

9  19 

624 

-.01 

Technical  vocabulary  (N)  CE205C . 

!•  67 

«  09 

49.32 

9.19 

624 

.05 

O&cer  quality .  . 

44  62 

C.  16 

5C.  36 

10.02 

595 

_ 

.07 

— 

ft 


t 


74 


.  Tuu  2Jb2.—Coenteti»nt  between  stenbus  mi  test  wnt  (x)  mi 
etr-io-sromni  gunnery  stores  (y) 

T-41  PILOTS— FOCAT7!  AIR  FORCE 


Tot  nriiUri 


Ka**** 

?»»»»** . 

»-im  imwh  CiiSiA . 

TEuLadCaord^rioa  CM1«A.. 

^^TdnUntr  CM  114A 


Tckaiol  Todbulxry  ffj  Cl  505C.. .. 
Ti^aial  Toabuliry  Ofl  CE  30$C. . . 
Tidual  wcilwhiy  (KdJOJt... 

Speed  of  idtstifatiM  CP410A . 

A  Cl  HOE... ....... .... 

Hitlcutici  A  Cl  HOF . . 

jUtkematka  B  C5710*. . 

Kitkcotia  B  CIJ04C . 

ta»pntoM«  AOOD-II _ 

lo^OK  cooprtWnsoa  QIUG . 

IteckuKsI  conprdwsnoa  AC10D-VT. 

Machaskal  priaciplea  G9Q3A. ...... . 

Mecksakml  snlcnnatioa  C190SA . . 

Dial  aad  table  rcadiacCPi21-22A.... 

Ksmerical  opRitioM  I CHUB . 

Numerical  Operations  II  Cl 7021 . 

Spatial  orientation  I  CPS01B . 

Sratkl  orieatalica  II  CJ5MB . 

Bicertphical  data  (P)  CEASD . .  . 

Bwcnphkal data  OOCKBID . 

Gcactal  ialormatka  fF)  CE505D . 

General  Inlonnation  (N)  CESOSD . 

Nmerical appeoximatioa  C1706A..... 

Aritbemetic  reaaoaiac  Cl  706A . 

Table  reatfin*  CP  421A . 

Dial  rtadhn  CP622A . 

Often  qaalitr  aeon . 


m. 

sow 

lJSL 

so, 

K 

«*.** 

4.M 

4.14 

1.74 

244 

49.49 

9.M 

4.99 

1.45 

244 

49.69 

9.(4 

4.17 

2.42 

244 

aa<* 

r  r? 

«•  Aft 

9.58 

«u 

49.41 

9.  SI 

52.74 

9.59 

235 

49.46 

4.S4 

54.lt 

19.19 

244 

«*.** 

4.M 

52.45 

9.53 

244 

4*.** 

9.44 

54.72 

9.  SI 

344 

4*.M 

9.51 

54.29 

US 

42 

4*.  7* 

9.13 

47.45 

14.02 

34S 

4*.  J7 

9.47 

24.72 

4.74 

194 

44.37 

9.47 

15.11 

4.24 

194 

44.37 

4.47 

5.74 

3.24 

14 

44.74 

9.S3 

17.58 

3.40 

302 

44.37 

9.47 

37.45 

17.12 

190 

50.74 

20.31 

25.30 

14.50 

S4 

49.34 

9.64 

40.86 

14.99 

144 

$0.79 

10.31 

19.04 

8.45 

54 

44.39 

9.43 

36.82 

19.25 

44 

49.74 

9.  S3 

25.49 

11.91 

:m 

49.39 

9.*$ 

9.49 

5.82 

44 

49.74 

9. S3 

62.71 

la.  29 

202 

49.34 

9.64 

15.20 

7.49 

144 

49.76 

9.  S3 

36.02 

S.ll 

202 

49.69 

9.  46 

17.02 

5 .77 

244 

49.69 

9.86 

15.93 

5.74 

246 

49.69 

9. 86 

59.20 

17.22 

244 

49.69 

9.S6 

23.70 

6.40 

244 

SI. 67 

9.49 

31.79 

4.37 

59 

51.67 

9.49 

23.13 

3.87 

59 

50.79 

10.31 

37.66 

5.54 

54 

50.79 

10.31 

22.75 

4.48 

54 

49.39 

9.S5 

11.05 

4.04 

44 

49.39 

9.85 

13.3* 

S.33 

44 

49.39 

9.85 

45.59 

10.60 

44 

49.39 

9.85 

26.70 

7.33 

44 

51.67 

9.49 

47.51 

. 

9.74 

59 

Table  2.63.— Correlations  between  stamps  and  test  scores  (*) 
skip  bombing  scons  (y) 

P-3*  PILOTS— FOURTH  AIR  FORCE 


^  **  » _ 7-8-9  - - 

rreojetor  Tinun 

M. 

SDw 

M, 

SD, 

If 

5.99 

USSa 

50.19 

10.19 

462 

5.79 

ImTI 

50.19 

10.19 

461 

5.82 

1  -51 

50.19 

10.19 

442 

51.28 

11.06 

50.08 

10.21 

444 

• 

54.26 

9.20 

$0.24 

9.94 

456 

— 

52.58 

8.79 

50. 19 

10.19 

442 

46.32 

10.39 

50.24 

9.94 

454 

55.05 

8.07 

50.19 

10.19 

462 

51.06 

9.99 

50.19 

10.19 

442 

24.13 

11.75 

50.24 

9.94 

454 

64.64 

17.99 

50.24 

9.94 

*54 

14.87 

8.09 

49.61 

11.00 

Dial  and  t*Hk  . 

36.08 

7.66 

50.19 

10.19 

442 

22.38 

6.46 

50.19 

10.19 

442 

Spatial  orient Rtirtfi  I  n>«Jl  R  . 

28.32 

5.77 

50.19 

10.19 

447 

34.81 

11.78 

50.19 

10.19 

462 

— 

32.56 

11.01 

50.19 

10.19 

462 

— 

Mathematic*  A  Cl 702 E  . 

25.05 

15.55 

49.34 

12.26 

76 

Mitinnifir*  A  ri702P  . 

25.49 

16.95 

50.36 

9.70 

386 

Mathematic,  B  C1710A  . 

38.57 

15.91 

49.34 

12.26 

74 

Mathematic  B  C1706T  . 

16.02 

9.32 

50.36 

9.70 

384 

•* 

Bepaphical data  OTCEMSD. . . . . . “ ! . 

29.06 

6.25 

50.37 

9.81 

374 

Bi^trtbhical  data  ftf)  CE602D  . 

22.29 

3.20 

50.37 

9.6! 

374 

34.52 

6.97 

50.19 

10.19 

462 

General  information  (N)  fT.tOsn  . . 

21.23 

5.39 

50.36 

9.70 

316 

General  infnrm.tirm  (PI  rF-SOSD  . . 

36.56 

C  33 

.‘0.36 

9.70 

366 

Technical  vocabulary  (fc)  CE505C . 

21.47 

6.94 

*9.34 

12.26 

76 

Technic*]  vocabulary  (B^  CE50SC  . * . * 

5.75 

2.85 

49,3a 

11.26 

76 

“ 

Technical  vat* ki.Ur^  fai  CESOSC  . 

15.96 

8.09 

49.34 

17.26 

76 

wDC«  quiljt»  ,  tTtt  ,  T ,  t  t . t . 

45.57 

9.99 

50.37 

>.81 

374 

— 

.08 


75 


m  11<3<  St  *SSStatS*St*3B*3SSMS«SS»M»  I  I  a*W*. 

•  •  •  •  •  '»*  •  •  •  •••••••  •  ••••  •  a  *  ,*  *  I  I  t  I  •  •  a  i  *  II  I  I  i 


T**a  ?jM.— Comktiont  betweta  Hashes  mi  Itii  Kfftf  W  «*4 

4n  bombing  mm  (j) 


T~n  nwn-rown  aj»  rates 


^  ns  -  - - ^ 

d^cnr  fwwmv 

M, 

SO. 

M. 

SO. 

M 

*6* 

■  —lamii.a^amlaua 

6.07 

>.:• 

49.36 

9.91 

621 

.6» 

_ j . t 

J.92 

1.12 

49.  J6 

9.92 

622 

-.61 

Pilot  Mania* . . . 

5.  #5 

1.4! 

4«.3i 

9.92 

622 

.63 

Kataiy  pwMh  CMtJM . 

32.61 

9.71 

49.20 

10.06 

342 

.11 

Two  hand  coordination  CMlOtA.. . 

54.58 

9.43 

49.40 

9.96 

J9£ 

fUTfilA. . . . 

3  32 

9.32 

49.36 

9.92 

62: 

.63 

Aiming  Mr***  CM2I1A . . 

46.12 

10.41 

49.40 

9.96 

293 

.61 

Pacrim  initios  reaction  tint*  OtUD. . 

31.00 

1.42 

49.36 

9.97 

622 

.61 

Finger  dexterity  CM  11 4A . . . 

31.21 

9.99 

49.36 

9.97 

622 

.11 

Kaadhg  comprehension  C16140 . . . 

24.13 

12.22 

49.40 

9.96 

793 

.61 

43  34 

17  if 

49.40 

t.H 

TfS 

(|] 

Mechanical  information  C1WSA . 

13!  95 

$;« 

49.26 

10.26 

263 

.07 

Dial  and  table  reading  CP622-21A . 

36.29 

t.OI 

49.36 

9.97 

622 

-.01 

Spatial  orieatatioo  U  CP5031 . 

23.04 

6.51 

49.36 

9.97 

622 

-.63 

Spatial  oricotatioo  I  CP301B . 

21.77 

3.71 

49.36 

9.97 

622 

-.03 

Numerical  cp-  “•  dona  (F)  CI7Q2B. . . 

33.01 

*1.71 

49.36 

9.97 

622 

.03 

Numerical  cre  ation*  (B)  C1702B . 

32.76 

11.30 

49.36 

9.97 

622 

.« 

Mathematics  A  C1702E . 

26.93 

16.02 

49.19 

10.25 

31? 

.« 

Mi  then*  tics  A  C1J02F . . . . . 

25.  $f 

16.70 

49.47 

9.77 

310 

.0) 

Mathematics  B  C1710A . 

40.12 

15.64 

49.19 

10.23 

312 

-.03 

Mathematics  B  C1206C . 

16.13 

9.16 

49.47 

9.77 

510 

-.01 

Biographies!  data  (P)  CE6C2D . . . 

29.01 

6.26 

49.56 

9.60 

463 

.03 

Biographical  data  (N)  CE602D . 

22.35 

3.14 

49.36 

9.60 

464 

.01 

Speed  of  identification  CP610A . 

34.62 

7.07 

49.36 

9.97 

622 

.02 

General  information  (N)  CE30SD . 

21.32 

3.42 

49.47 

9.77 

510 

.01 

General  information  CP)  CE305D . . . 

36.77 

6.16 

49.47 

9.77 

519 

.01 

Technical  vocabulary  CP)  CX5Q5C . . . 

21.46 

6.47 

49.19 

10.23 

3*2 

.63 

Technical  vocabulary  (B)  CE50SC . 

3.94 

3.19 

49.19 

10.25 

312 

.06 

Tecbnknl  vocabulary  (N)  CES05C . 

16.02 

6.43 

49.19 

10.25 

m 

.11 

CXocar  quality .  . 

43.76 

9.40 

49.36 

9.60 

463 

-.11 

*> 


Tabu  2.65. — Correlations  between  stonmes  and  teat  scorn  (x) 
mission  grades  (y) 

P-38  PILOTS — FOURTH  AIK  FORCK 


Predictor  variables 

BonbtitKcr  itinist . . 

Navigator  Manias . 

File*  Mania* . 

Rotary  purrcit  CM  803 A . 

Two  band  coordination  CMlOtA . 

Complex  coordination  CM  70 1 A . 

Aiming  (Urn  CM2UA . 

Diacrimi nation  reaction  time  CP611D. . 
Finger  dexterity  CM116A . 

Reading  comprebenaioo  C16140 . 

Mechanical  principle*  Cl 903 A . 

Mechanical  Information  0903 A . 

Dial  and  table  reading  CP622-21A . 

Spatial  orientation  II  CPS03B . 

Spatial  orientation  I  CPSOlB . 

Numerical  operation*  (F)  C1702B . 

Numerical  operation*  (B)  C1702B . 

Mathematic*  A  Cl 702E . 

Mathematic*  A  C1702F . . 

Mathematic*  B  C1710A . 

Mathematic*  B  Cl206C . 

Biographical  data  (Pi  CE602D . 

Biographical  data  (N)  CE602D . 

Speed  of  identification  CP610A . 

Ge'tral  information  (N)  CE305D . 

General  Information  (P)  CE50JD . 

Technical  vocabulary  f P)  CES05C . 

Technical  vocabulary  (BJ  CF.505C. . . . 
Technical  vocabulary  (N)  CE505C. . . . 
Officer  quality . 


M. 

SD. 

M, 

-D» 

N 

5.97 

1.77 

49.33 

10.37 

432 

.06 

5.80 

1.77 

49.33 

10.57 

432 

.04 

5.75 

1.56 

49.33 

10.37 

<32 

Mi 

51.55 

10.94 

49.24 

10.64 

415 

•M6 

53.42 

9.60 

49.40 

10.35 

420 

.09 

32.24 

9.30 

49.33 

10.37 

432 

.01 

46.47 

10.77 
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Tabu  2.69  .—Correlations  between  stanines  and  test  scores  and  occurrence 
of  accidents  ascribed  to  p3ot  error 
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o  =  POjU  with  accidents  ascribed  to  pilot  error,  t  =  All  pilots  (including  those  with  accidents). 
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Bombardier  staaina . . 

Navigator  atanise . 

Mot  itanine . 

Rotary  pursuit  CM  80JA . 

Two  hand  coordination  CM  10 1 A . 

Complex  coordination  CM701A . 

Aiming  stmt  CE2UA . 

Discrimination  reaction  time  CP6I1D. 

Finger  dexterity  CM1I6A . 

Technical  vocabulary  (PI  CE503C. ... 
Technkai  vocabulary  (B)  CESOSC . . . . 
Technical  vocabulary  (N)  CESOSC. . . . 

Speed  o(  identification  CP610A . 

Mech.-'nical  principles  C 1903 A . 

Mathematics  A  CI702E . 

Mathematics  B  C1710A . 

Spatial  orientation  I  CPS01B . 

Spatial  orientation  II  CPS03B . 

Reading  comprehension  CI614G . 

Mechanical  information  CI90SA . 

Numerical  operations  I  C1702B . 

Numerical  operations  II  C1702B . 

Dial  and  table  reading  CP622-21A. . . . 
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From  the  data  it  the  above  tables  a  number  of  observations  can  be  made. 
Ia  general,  it  is  clear  that  no  one  test  showed  a  high  degree  of  relationship 
with  any  of  the  criteria  studied.  Although  of  statistical  significance,  no 
correlation  between  a  single  'test  and  a  criterion  is  sufficiently  high  to  be  of 
practical  value  in  prediction.  Fo’  convenience  in  obtaining  an  over-al 
view  of  test  validity  there  are  listed  in  fable  2.70  sll  validity  coefficients 
for  P-38  pilots  that  were  sufficiently  large  to  be  of  statistic  1  significance. 
From  this  table  it  is  dear  that  the  test  battery  as  a  whole  best  predicted 
the  criterion  of  elimination  by  Flying  Evaluation  Board  action  with  pre¬ 
diction  of  air-to-air  gunnery  performance  a  dose  second.  Among  the 
various  predictor  variables  the  stanines,  being  based  upon  combinations  of 
test  scores,  naturally  predicted  the  largest  number  of  criteria.  In  order  of 
effectiveness  in  prediction  the  three  stanines  were  roughly  pilot,  bom¬ 
bardier  and  navigator.  Among  the  individual  tests  the  Rotary  Pursuit  and 
Two  Hand  Coordination  Tests  seem  to  have  best  predicted  all  of  the 
criteria.  Mechanical  Principles  and  Reading  Comprehension  were  approxi¬ 
mately  the  next  best  in  prediction. 

Tests  such  as  Numerical  Operations,  Finger  Dexterity,  Aiming  Stnws 

4 

Tab  ix  2.70-  -Summary  of  si  ini  ft  cent  < 1  percent  nr  5  percent  level)  correlations 
between  predictor  variables  and  criterion  scons 
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Rotary  pursuit  CM80JA . . . 
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Dacrimination  reaction  time  CP61  ID . ■{••• 

Finger  dexterity  CMI16A . . . • 

Kcxding  com  prehension  OllA . . . 
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Technical  vocabulary  (Mj  CE505C . •• 

Officer  quality.. . . . . 


‘Criterion  variables  ara  u  follow*: 
1.  Alr-to-Alr  Gunnery 
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4.  Dhra  BotnbSf 
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5.  Mlasioa  Gradaa 

6.  Adversity  Score* 

1.  Accident* 

I.  FF.B  Ra-ev*hutloa 


and  Vocabulary  (N)  and  Biographical  Data  lor  Navij'5*or»  had  little  ^ 
dfctive  value  for  the  criteria  studied.  Among  the  various  criteria,  skip 
and  dive  bombing  were  predicted  very  poorly  by  most  of  the  tests  and 
staninesi 

Other  Methods  oj  Validate* 

Besides  expressing  degree  of  validity  as  a  coefficient  representing  the 
corr Jation  between  test  scores  and  a  proficiency  criterion,  it  would  be 
possible  to  show  relative  validities  by  comparing  the  mean  test  scores  of 
pilots  of  different  levels  of  proficiency.  The  latter  procedure  has  a  great 
advantage  in  simplicity  and  ease  of  calculation,  especially  when  the  groups 
compared  -re  at  the  extremes  of  the  range  of  proficiency  found.  The  tests 
which  yielded  the  greatest  and  most  consistent  differences  between  the 
averages  for  the  groups  would  naturally  be  those  which  best  predicted  de¬ 
gree  of  proficiency.  By  this  method  the  numbers  of  individual  pilots  in¬ 
volved  would  be  greatly  reduced  while  at  the  same  time  little  discriminat¬ 
ing  power  would  be  lost  since  these  groups  may  be  expected  to  show  to  a 
maximum  degree  any  relationship  that  existed. 

For  these  reasons  it  was  decided  in  the  First  Air  Force  to  make  the 
initial  study  of  test  validities  by  comparing  the  average  test  scores  and 
stanines  of  two  groups  of  pQots,  one  extremely  high  and  the  other  extremely 
low  in  proficiency.  Only  for  those  tests  which  showed  by  this  method  a 
promising  degree  of  validity  would  more  extensive  analyses  be  made  and 
validity  coefficients  computed  for  the  total  group  of  pQots  studied.  It  was 
not  possible  to  complete  this  analysis  in  time  for  inclusion  in  this  report 

0 

Evaluation 

In  the  resi  '*s  presented  above  it  would  appear  at.  first  glance  that  at 
the  level  of  operational  training,  classification  test  scores  and  the  pilot 
stanine  have  a  relatively  small  predictive  value.  However,  in  considering 
the  validity  coefficients  obtained  it  should  be  remembered  that  there 
were  a  number  of  factors  present  which  tended  to  put  a  "ceiling”  on  the 
size  of  the  correlation  coefficients  to  be  expected  between  stanines  and 
proficiency  measures.  Four  factors  might  be  mentioned  here. 

Restricted  Range  of  the  Pilot  Sto/tme  ^ 

Assuming  that  the  unaugmented  pilot  stanines  of  original  applicants  for 
aircrew  training  were  normally  distributed  from  1  to  9,  data  in  table  IS'- 
show  that  less  than  20  percent  of  the  pilots  reaching  operational  training 
had  stanines  as  low  as  the  median  of  the  group  of  original  applicants.  The 
rejection  at  the  classification  centers  of  nearly  all  applicants  with  sfanines 
of  1  and  2  and  rejection  of  many  with  stanines  of  3  and  4  resulted  in  the 
initial  range  restriction.  The  fact  that  in  training  in  the  AAF  Training 
Command  men  with  j  jw  stanines  were  much  more  frequently  eliminated 
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than  men  with  high  stanines,  produced  a  further  limitation  in  atanfat  range 
in  the  group  sent  on  to  operational  training, 

Restricted  Range  of  Pro/Ukncy 

The  elimination  of  most  of  the  pilots  of  very  low  degree  of  proficiency 
in  the  AAF  Training  Command  undoubtedly  resulted  in  a  range  at 

proficiencies  in  pilots  entering  operational  training.  Opinions  of  »— »y 
training  supervisors  that  all  pilots  in  operational  training  were  at  least 
average  and  were  satsfactory  in  proficiency  tended  to  -ear  this  • 

Inconsistency  and  Low  Reliability  of  Criterion  Scant 

The  reliability  of  a  measure  determines  in  part  the  maximum  correlation 
that  could  be  obtained  with  any  other  measure  even  if  identical  functions 
were  involved  in  both  cases.  While  the  reliability  of  some  of  the  criteria 
studied  was  as  high  as  0.70,  it  was  in  many  cases  much  lower.  And  for 
several  criteria  it  was  not  possible  to  obtain  any  estimate  of  reliability.  In 
such  cases  the  many  known  sources  of  uncontrolled  variation  would  in- 
dicate  a  rather  low  reliability.  Hence,  many  of  the  validity  coefficient! 
could  only  be  low  at  best 

Dissimilarities  in  Primary  Flying  and  Operational  Training 

Since  tests  and  selection  procedures  were  mainly  validated  against  success 
or  failure  in  primary  training,  they  could  not  be  expected  to  cover,  except 
more  or  less  by  chance,  any  abilities  needed  in  operational  training  which 
were  not  prominent  in  earlier  training.  Here  a  thorough  validation  of 
individual  test  scores  against  criteria  of  proficiency  in  operational  training 
might  lead  to  a  different  weighting  of  tests  and  specific  abilities  so  as  better 
to  predict  success  at  this  and  the  combat  levels. 

The  data  so  far  obtained  indicate  that  the  pilot  stanine  best  predicts  com¬ 
ments  on  missions,  ratings  obtained  by  interviewing  instructors,  and  time 
taken  to  complete  all  or  part  of  training.  Because  of  the  relatively  low 
coefficient  of  reliability  of  gunnery  scores,  it  is  a'so  likely  that  the  stanine 
predicts  even  better  pilots’  gunnery  ability  although  the  prediction  of  the 
gunnery  scores  is  less  accurate  than  the  prediction  of  the  other  types  of 
scores  just  mentioned. 


SUMMARY 

Research  personnel  in  the  First,  Second,  and  Fourth  Air  Forces  amassed 
a  great  amount  of  data  on  fighter-pilot  proficiency  in  the  P-38,  P-47,  and 
P-61  aircraft.  The  several  types  ol  potential  criterion  measures  which  wen 
systematically  explored  and  evalua  ted  included  scores  obtained  from  air-to- 
air  and  air-to-ground  fixed  gunDiry,  dive  and  skip  bombing,  and  rocket 
firing;  comments  and  ratings  from  mission  cards;  tower  and  mobOe-contro? » 
unit  reports;  ratings  by  instructors  (on  printed  forms  and  obtained  from 
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interviews),  ratings  and  rankings  by  fellow  students;  amount  of  that 
required  to  complete  training;  involvement  in  pilot-error  accidents;  selec- 
don  as  instructor;  re-evaluation  by  a  Flying  Evaluation  Board. 

Insofar  as  possible,  the  above  potential  measures  of  pilot  proficiency  wen 
re-evaluated  in  terms  of  sis  criteria:  distribution,  reliability,  number  of 
men  affected,  discrimination  between  experienced  (“expert”)  and  inex¬ 
perienced  (“novice”)  pilots,  completeness  of  coverage  of  the  pilots'  duties, 
and  degree  of  objectivity. 

It  was  concluded  that  the  most  satisfactory  pilot  proficiency  measures 
were  the  objective  scores  derived  from  gunnery,  bombing,  and  rocket  firing; 
the  specific  comments  entered  on  mission  cards;  and  ratings  (based  on 
concrete  reasons)  obtained  from  interviewing  instructors.  It  was  further 
conclude,  that  no  single  one  of  the  measures  adequately  covered  the  full 
range  of  fighter-pilot  duties.  It  was  also  felt  that  little  dependability  could 
be  placed  on  any  of  the  measures  except  where  original  preparation  of  the 
data  was  closely  supervised  at  the  training  stations  by  aviation  psychol¬ 
ogists. 

The  pilot  stanine  was  found  best  for  predicting  comments  on  mission 
cards,  ratings  obtained  from  interviewing  instructors,  time  required  io  com¬ 
plete  all  or  part  of  training,  and  re-evaluation  by  Flying  Evaluation  Boards. 
Stanine  validity  coefficients  with  the  various  criterion  measures  were  low¬ 
ered  by  such  factors  as  the  small  number  of  cases  (affecting  particularly 
re-evaluated  men,  accident-pilots,  and  trainees  selected  as  instructors), 
restricted  range  of  both  the  pilot  stanine  and  pilot  proficiency  at  the 
operational  level,  and  the  lew  reliability  of  the  criterion  measures.  This 
last  factor  was  considered  particularly  to  lower  the  degree  of  correlation 
between  stanine  and  fixed-gunnery  scores. 
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CHAPIEB  TERES _ _ 

Photo-Reconnaissance  Pilot 


ANALYSIS  OF  DUTIES  ' 

Introduction 

Most  of  the  training  of  individuals  and  crews  in  the  specialized  field  of 
photographic  reconnaissance  was  done  in  the  Third  Air  Force.  Studies  is 
this  field  were  therefore  made  one  of  the  responsibilities  of  aviation  psychol¬ 
ogy  personnel  in  this  Air  Force.  Training  in  Photo-reconnaissance  included 
four  main  types:  F-3  training  concerned  with  night  photographic  reconnais¬ 
sance  utilizing  A-20  aircraft;  F-S  training,  target  photo-reconnaissance  and 
tri-metrogonic  mapping  (mosaics)  in  P-38  type  aircraft;  F-6  training, 
invol  ving  tactical  reconnaissance,  both  visual  and  photographic,  in  P—51 
aircraft;  and  F-7  training  utilizing  B-24  crews  for  long  range  precision 
mapping.  Preliminary  investigation  suggested  that  die  F-S  training  pro¬ 
gram  would  be  the  most  profitable  area  for  initial  research  in  photo- 
reconnaissance,  since  the  available  records  were  relatively  well  suited  to 
validation  studies.  Investigation  of  the  other  three  types  was  prevented  by 
the  curtailment  of  training  at  the  dose  of  hostilities.  The  discussions  which 
follow  in  this  chapter  are  therefore  limited  to  the  F-S  program. 

Job  Description 

The  F-S  training  program  consisted  of  four  months  training  of  P-38 
pilots.  It  was  divided  into  four  phases:  ground  training,  photographic 
transition  in  B-25  or  F-10  type  aircraft,  training  in  P-38  type  aircraft  and, 
finally,  night  familiarization. 

Ground  Treating 

Durvj*  this  phase,  instruction  was  given  in  operation  of  the  aircraft, 
co;.-jat  tactics,  administration  duties  and  general  subjects.  Training  pub¬ 
lications,  films  and  information  bulletins  were  used  for  instruction  purposes. 
Elimination  for  failure  in  ground  school  subjects  was  very  rare. 

Photographic  Transition 

This  phase  was  designed  to  acquaint  the  trainee  with  the  fundamentals 
of  navigation  and  aerial  photography.  The  flights  were  in  B~25  or  F— 10 
type  aircrafts.  The  trainee  spent  5  hours  as  observer  (standing  behind  the 
pilot  and  copilot),  five  hours  as  navigator  and  S  hours  as  copilot. 
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Training  in  P-Ji  Tyfa  Aircraft 

The  largest  portion  of  the  four  months  training  period  was  devoted  to 
training  in  the  F-5  type  aircraft  (P-48  modified  for  photographic  recon¬ 
naissance  purposes).  It  was  necessary  for  the  trainee  to  acquire  complete 
knowledge  of  the  performance  data  and  operational  limitations  of  the  P-48. 
In  addition,  each  trainee  had  to  complete  the  following  requirements: 

1.  A  minim'-m  of  five  photo-reconnaissance  missions,  with  an  average 
grade  of  85  percent  At  least  one  of  the  missions  had  to  be  above  30,000 
feet  A  minimum  of  two  missions  were  required  at  the  maximum  tactical 
range  of  the  aircraft 

2.  One  successful  mapping  mission  at  20,000  feet  or  above,  covering  an 
area  at  least  10  by  20  miles  in  size.  The  yrade  for  this  mbsion  had  to  be  75 
percent  or  better  to  be  considered  successful. 

Night  Photo  PamUiaruation 

This  phase  of  training  was  designed  to  acquaint  the  trainee  with  the 
capabilities  and  limitations  of  photo- flash  bulbs,  electrical  flash  equipment 
and  proper  techniques  and  tactics  to  be  employed  in  the  use  of  night 
cameras.  The  trainee  was  required  to  demonstrate  competency  in  the  opera¬ 
tion  of  the  K-19B  camera  and  related  equipment,  and  in  the  handling  of 
bomb  bays,  shackles  and  release  mechanisms.  He  was  further  required  to 
know  how  to  load,  arm  and  inspect  flash  bulbs. 

Job  Specifications 

No  studies  were  made  of  special  requirements  for  the  job  of  the  F-5  or 
photo-reconnaissance  pilot,  although  some  of  the  requirements  may  be  in¬ 
ferred  from  the  foregoing  description  of  operational  training.  Other  studies 
of  higher  priority  prevented  any  detailed  analysis  of  this  type. 

s 

\ 

CRITERIA  OF  PROFICIENCY 

General 

Four  types  of  grades  were  given  in  the  F-5  program.  The  first  consisted 
of  the  descriptive  ratings  “satisfactory,”  “very  satisfactory.”  and  “s»tperior” 
on  most  ground  school  subjects.  Several  grades  of  “qualified”  and  “not 
qualified  ’  were  assigned  in  such  subjects  as  code,  blinker,  altitude  chamber 
and  instrument  flying.  The  third  grade  was  “time  in  hours”  for  the  various 
types  of  flying  such  as  B-25  training,  P-38  transition,  and  night  flying. 
The  fourth  type  consisted  of  numerical  grades  based  upon  a  standard  and 
more  or  less  objective  system  of  scoring  short  range  photo,  and  lon&  range 
photo  and  mapping  missions.  Preliminary  investigation  of  these  four  sys¬ 
tems  indicated  that  the  relatively  objective  mission  or  sortie  scores  were  ' 
the  best  measure  of  proficiency.  Main  research  effort  was  therefore  con¬ 
centrated  on  the  sortie  grade. 
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Sortie  Grade* 

Dtscriptio* 

The  following  procedure  was  used  in  assigning  grades  to  photographic 
and  mapping  missions.  The  pilot  was  briefed  on  targets  to  be  photographed, 
flying  altitude,  and  dying  time  for  the  mission  and  course.  Preflight  of  the 
plane  and  photographic  equipment  was  the  responsibility  of  the  pilot  Dar¬ 
ing  the  mission,  the  pQot  was  required  to  keep  an  accurate  log  with  . 
reference  to  weather  and  flying  altitude  over  each  target  Upon  return  from 
the  mission  in  addition  to  the  photographic  plates  exposed,  the  pilot  pro* 
vided  the  following  information  to  the  Interrogation  Office: 

1.  Name  and  number  of  targets  assigned. 

2.  Name  and  number  of  targets  claimed. 

3.  Mean  photographic  altitude. 

4.  Weather  conditions  over  targets. 

5.  Camera  lens  size. 

6  Description  of  targets  of  opportunity  (if  daimed). 

7.  Condition  of  equipment 

After  the  photographic  plates  were  processed,  the  prints  were  sent  to  the 
Photo  Laboratory  for  grading.  The  judgment  as  to  whether  a  target  was 
scored  as  covered,  partially  covered  or  not  covered  was  dependent  upon 
lens  size  as  well  as  percent  of  target  in  the  photograph.  The  scale  used  Is 
presented  in  table  3.1. 

After  coverage  was  determined,  the  photo  interpreter  determined  and 
recorded  a  sortie  mission  grade  for  the  pilot  listing  the!  mission  number, 
total  time  in  the  air,  mean  altitude  of  photography,  number  of  targets  as¬ 
signed,  number  claimed,  number  of  targets  of  opportunity  claimed,  num¬ 
ber  of  targets  not  claimed  with  the  reason  given,  and  finally,  for  each  size 
of  lens  used,  the  number  of  targets  covered,  partially  covered  and  not 
covered.  In  obtaining  the  final  grade,  one  credit  was  given  for  all  targets 
covered,  one-half  credit  for  targets  partially  covered  and  no  credit  for 
targets  not  covered.  The  final  mission  grade,  indicated  in  percent  was  the 
ratio  of  targets  covered  (total  credit)  to  targets  assigned  plus  targets  of 
opportunity  less  nonpflot  failures. 

Table  3.1  Relation  between  percent  of  covfrage  and  sccrc  assigned  target  photographs 

f 

F-S  PHOTO  RECONNAISSANCE— THIRD  AIR  FORCE 


Lens  site  Percent  J  'dement  or 

(inches)  coverage  score 

6  .  0-  4  Not  Covered. 

6  .  5-  95  Partially  Covered. 

6  . . 96-100  Covered.  N 

12  by  24 . . . 0-  4  Not  Covered. 

12  by  24  . . .  5-  75  Partially  Covered. 

12  by  24  .  76-100  Covered. 
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la  general,  a  single  uisaaem  i iaduded  fraa  12  to  IS  assigned  targets.  T* 
be  regarded  as  complete,  the  mission  bad  to  com  at  leas:  S  targets.  Targe* 
o I  opportunity  codd  be  piator^u  ociy  in  Bea  o f  assigned  targets  which 
coalS  aot  be  phcrographed  loc  legitimate  reasons,  or  la  addition  to  regiffmfr 
aawgnrd  targets.  Scores  oa  both  successful  and  unsuccessful  afaloa^  Le. 
aasaoa  grade  below  as  vdl  as  above  75  percent  were  toed.  However,  (W 
percentage  of  Missions  graded  less  than  75  percent  was  very  seal,  less  than 
1-5  percent  for  a  sample  of  7M 

The  coefficient  of  conrfation  between  the  swage  sortie  grade  for  odi 
aad  eves  missions  was  found  to  be  0.62  for  152  pilots  trained  at  Coley, 
idle  Army  Air  Base  daring  May  and  Jane  of  1945.  Other  estimates  of  fit 
refiaesfity  of  these  scenes  are  presented  la  table  3-2. 

Tmu  JJ. — IfiiMry  «/  yieCa  wntewg  wrtit  temm 
commai  aas-man  ant  roues 

Mmmher  c*tn  r 


Pint  short  riiwiiw  *.  awt  short  adbrioa . 1ST  007 

Pint  loaf  aissos  ».  sccsod  Inr  aUn . 1S9  JJ 

fatBttiri  irSziaSty  (canceled  fcjr  Spunm-Btm  fsmb)  .  H  jj 


Since  the  sortie  grade  was  the  only  criterion  studied,  no  comparisons  are 
possible  with  other  criteria.  However,  the  following  points  can  be  made  oa 
the  baas  of  the  evidence  available.  First,  it  is  not  possible  to  determine 
the  ertcnl  to  -hich  sortie  grades  discriminate  between  pilots  known  to 
differ  in  proficiency  and  experience  since  no  such  studies  could  be  carried 
oat  Second,  scored  sortie  grades  have  a  rather  narrow  dispersion.  Whether 
this  is  due  to  the  nature  of  the  task  in  rdaiioo  to  method  of  soaring,  or  to 
actual  similarity  in  lewd  of  proficiency  of  pilots  in  this  type  of  operational 
training  is  not  known.  Third,  the  reliability  of  sortie  grades,  while  not  as 
high  as  might  be  desired,  is  sufficient  for  them  to  be  useful  in  validation 
studies.  Fourth,  in  terms  of  coverage  of  the  job  and  logical  validity  tfrrw 
grades  at*  an  excellent  criterion.  Finally,  since  the  pilots  concerned  an 
not  known  to  those  assessing  target  photographs,  sortie  grades  are  not  sub¬ 
ject  to  most  types  of  subjective  errors.  Estimates  of  percent  of  targets  ap¬ 
pearing  in  the  photographs,  and  decision  as  to  whether  a  failure  to  attempt 
photographs  occurred  as  a  result  of  causes  beyond  control  of  the  pilots,  are 
possible  sources  of  errors  of  various  sorts.  In  general,  i;  may  be  concluded 
<hat  the  sortie  grade  should  provide  a  useful  criterion  of  proficiency  ia 
operational  training. 


VALIDATION 

Average  sortie  grades  of  trainees  at  the  two  Third  Air  Force  station* 
training  F-5  pilots  were  correlated  with  their  aptitude  scores  or  stanines. 
In  this  comparison,  only  trainees  who  had  completed  a  minimum  of  6 
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photographic  missions  were  included.  The  coefficients  of  validity  obtained 
are  shown  in  table  3  J  together  with  the  appropriate  means  and  standard 
deviations. 

Attention  is  called  .to  th;  relatively  higher  validity  of  the  navigator 
stanine.  This  result  should  be  interpreted  with  caution,  however, 
the  group  had  been  restricted  with  respect  to  the  pilot  stanine.  Validity 
coefficients  for  both  the  bombardier  and  navigator  stanine  are  significant 
at  the  1  percent  level  and  were  regarded  as  sufficiently  high  to  warrant 
the  computation  of  test  validities.  This  was  not  done,  however,  due  to  the 
shortage  of  time. 

Separate  grades  were  available  for  short  and  long  missions  for  about  one 
hundred  trainees  at  Will  Rogers  Field.  Comparison  was  therefore  made 
between  stanines  and  grades  on  each  type  of  mission  to  find  out  whether 
length  of  mission  was  a  factor  in  stanine  validity.  Validity  coefficients 
with  unaugumented  pilot  stanine  were  0.11  and  0.16  respectively  for  short 
and  long  mission  (sortie)  grades  of  105  F-5  pilots  for  whom  separate 
scores  were  available.  Although  the  difference  between  the  coefficients  is  not 
statistically  significant,  there  is  a  suggestion  that  the  pilot  stanine  better 
predicts  the  grade  on  long  than  on  short  missions. 

SUMMARY 

Research  by  aviation  psychologists  in  the  area  of  photo-reronnaissanoe 
training  was  limited  to  the  F-5  program.  This  program  was  concerned  with 
the  training  of  P-38  pilots  in  target  photo- reconnaissance  and  trimetrogonk 
mapping  (mosaics).  One  criterion  measure  for  this  type  of  training  was 
investigated,  that  of  objective  mission  grades  for  photographic  reconnais¬ 
sance  missions.  The  grades  were  based  on  the  extent  to  which  assigned 
targets  were  covered  in  the  photographs  obtained  by  the  trainee.  The  re¬ 
liability  of  the  mission  grade  criterion  was  found  to  be  satisfactory  for 
validation  purposes.  For  two  samples  of  F-5  trainees  for  whom  both 
stanines  and  mission  grades  were  available,  stanine  validities  were,  in  gen¬ 
eral,  lr»w;  however,  several  coefficients  were  higher  than  could  be  expected 
ty  chance  alone. 
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CHAPTER 


Airplane  Commander 


ANALYSIS  OF  DUTIES 


Int*-  iuction 

It  was  the  mission  of  th  .•  Continental  Air  Forces  tc  train  in  combat  type 
operations  combat  crews  made  up  of  individuals  who  had  completed  train* 
ing  in  their  individual  specialties.  Because  of  the  primary  emphasis  upon 
the  training  of  crews,  training  personnel  paid  relatively  litUe  attention  to 
individual  proficiency,  most  of  the  attention  being  given  to  crew  perform¬ 
ance.  Although  aviation  psychologists  in  the  Continental  Air  Forces  were 
similarly  interested  mainly  in  crew  proficiency,  two  factors  led  to  the  ex¬ 
penditure  of  much  time  and  energy  in  obtaining  evidence  of  individual 
proficiency  as  well.  The  first  of  these  was  a  desire  to  obtain  data  for  use 
in  studying  the  validity  of  individual  selection  and  classification  procedures. 
The  second  was  the  fact  that  since  no  satisfactory  objective  measure  of  it 
was  available,  crew  proficiency  was  thought  by  many  to  be  best  observed 
in  the  individual  proficiency  of  various  crew  members,  particularly  the  air¬ 
plane  commander. 

The  airplane  commander  was  probably  the  most  important  member  of 
the  combat  crew.  As  fcommander  of  his  crew,  he  was  responsible  for  their  . 
performance  as  well  as  his  own.  From  the  point  of  view  of  psychological 
research  in  operational  training,  the  airplane  commander  was  also  important 
because  he  was  responsible  for  much  of  the  training  of  the  rest  of  the  crew. 
His  many  contacts  with  instructors  and  training  personnel  made  him  by  far 
the  best  known  member  of  the  crew.  It  was  thus  expected  that  more  and 
better  data  would  be  available  on  the  proficiency  of  the  airplane  com¬ 
mander  than  would  be  available  for  my  other  aircrew  specialty.  And,  as 
will  be  brought  out  later,  the  proficiency  of  the  crew  as  a  whole  and  that 
of  the  .iirplar.c:  commander  were  usually  considered  nearly  identical. 

Job  Description  ,  . 

Because  of  his  special  importance  in  training  and  in  combat  operations, . 
research  personnel  in  the  Continental  Air  Forces  studied  the  job  of  the  air¬ 
plane  commander  in  operational  training  in  greater  detail  than  they  did  the 
jobs  of  the  other  crew  members.  Information  was  obtained  from  a  variety 
of  sources.  AAF  Training  Standards  20-2  and  20-3,  Training  Manuals  such 
as  Second  Air  Force  Manuals  50-27,  50-51,  50-126  and  similar  Manuals 
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of  tie  Third  end  Fourth  Air  Forces  were  consulted.  Interviews  were  held 
with  Directors  of  Tuning,  with  instructors,  with  sirplane  commander 
trainees  and  with  officers  returned  from  combat  in  an  attempt  to  obtain  as 
much  information  as  possible  about  the  duties  and  requirements  of  the  job 
of  airplane  commander. 

The  usual  heavy  and  very  heavy  bombardment  crew  training  in  the  Con* 
tinental  Air  Forces  covered  a  period  of  12  weeks.  It  included  both  flying 
and  ground  school  training.  A  minimum  of  120  hours  of  flying  was  re* 
quired  of  each  crew,  although  in  practice  most  crews  needed  more  flying 
hours  than  this  to  complete  the  required  operations.  Flight  training  was 
set  up  in  the  form  of  specific  missions  of  many  types,  with  the  number  of 
hours  in  the  air  needed  for  each  varying  according  to  the  mission  require¬ 
ments.  Included  were  relatively  short  and  long  range  missions,  missions  at 
high  and  low  altitudes,  night  and  day  missions,  bombing,  navigation  and 
fighter  interception  missions.  A  total  of  26  different  missions  were  required 
in  R-29  (VH)  training,  several  of  which  had  to  be  repeated  to  meet  mini¬ 
mum  requirements.  In  B-17  and  B-24  (H)  training,  a  larger  number  of 
missions  was  required;  but  the  length  of  time  needed  to  accomplish  the 
individual  missions  was  correspondingly  less.  Details  of  each  mission  were 
specified  in  flight  training  directives  which  listed  the  operatons  to  be  per¬ 
formed  and  the  responsibilities  of  the  various  crew  members. 

Similarly,  the  ground  training  of  airplane  commanders  and  other  crew 
members  was  specifier  in  Technical  Training  Manuals  and  ground  training 
directives.  Very  little  of  the  ground  training  was  given  to  crews  as  units, 
separate  classes  being  given  for  individuals  in  each  specialty.  Airplane 
commanders  took  courses  in  the  technical  aspects  of  plane  operation,  com¬ 
munications,  navigation  and  bombing.  Courses  were  required  of  most  anew 
members  in  intelligence,  survival  and  the  usual  military  subjects.  The 
airplane  commander  and  certain  of  the  other  crew  members  took  courses  in 
combat  tactics.  In  addition,  the  airplane  commanders  took  6  hours  of 
ground  school  under  the  general  headings  of  duties  and  responsibilities  of 
the  airplane  commander.  Ordinarily  there  were  no  particular  objectives  or 
requirements  for  these  6  hours  and  individual  instructors  utilized  them  as 
deemed  desirable.  Sometimes  the  time  was  devoted  to  confers  ~es  on  the 
problems  which  had  arisen  in  the  handling  of  the  crews  and  rela'ed  mat¬ 
ters.  At  other  times  training  films  were  shown  and  lectures  given  by  re¬ 
turned  pilots. 

The  responsibilities  of  the  airplane  commander  as  leader  and  comma*/.*! 
of  the  crew  were  usually  given  extra  emphasis  in  some  way.  At  orientation 
lectures,  informal  conferences  with  instructors  and  in  the  appropriate 
ground  school  courses  suggestions  were  given  as  to  what  these  respon¬ 
sibilities  were  and  how  they  could  be  met.  These  included  suggested  means 
of  utilizing  “waiting  hours,”  c.g.  time  spent  waiting  for  transportation, 
briefing,  weather  clearance,  etc.;  ways  of  gaining  knowledge  of  crews’  back¬ 
ground;  methods  of  instruction  in  crew  specialties;  and  so  on.  Flight  train- 
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jog  records  w usually  made  available  lo  the  airplane  commander.  Ob 
cjlCCi  rides,  notes  were  sometimes  made  on  his  effectiveness  as  commander. 
However,  the  latter  were  informal  and  k  phazard  and  do  systematic  records 
at  checks  were  kept  on  the  ability  of  the  pilot  to  command  his  crew. 

At  n»any  stations,  the  airplane  commander  W2S  given  certain  definite  re¬ 
sponsibilities  for  the  training  of  the  rest  of  the  crew.  These  included  »- 
jpoosibil'ty  for  the  punctual  attendance  of  each  crew  member  at  his  dasaes 
and  formations.  Absences,  tardiness,  etc.,  were  reported  to  the  airplane 
oxnmander  who  had  to  present  to  training  officials  the  reasons  therefor  and 
disciplinary  action  taken  to  prevent  recurrence.  Deficiencies  in  class  week 
and  in  flight  were  reported  to  the  airplane  commander  for  action  to  correct 
them.  He  was  often  responsible  for  keeping  the  crew  infermea  of  training 
progress.  In  addition  to  the  regular  briefings,  tLe  airplane  commander  was 
encouraged  to  give  additional  explanations  to  his  crew  specifying  the  part 
each  crew  member  was  to  play  in  accomplishment  of  the  miss* on.  Review 
of  previous  mistakes  and  suggestions  for  improvement  were  to  be  given. 
At  the  conclusions  of  missions,  the  airplane  commander  was  frequently  re¬ 
quired  to  hold  a  critique  o?  the  mission  with  the  crew,  discussing  the 
performance  of  each  crew  member.  The  airplane  commander  was  respon¬ 
sible  for  seeing  to  it  that  crew  members  kept  busy  on  all  missions,  assisting 
other  crew  members  ii  their  own  specialty  was  not  needed. 

Probably  the  best  summary  of  the  duties  and  responsibilities  of  the  air- 
place  commander  in  operational  training  that  given  in  AAF  Training 
Standard  20-2: 

The  pilot  will  be  trained  to  k  standard  enabling  h:m  to  handle  his  aircraft  with 
Aill  iim!  confidence.  In  addition  to  piloting  skill,  he  must  be  fully  instructed  in  Us 
duties  and  responsibilities  as  airplane  commander  to  insure  that  he  exerciser  proper 
supervision  over  the  personnel  and  equipment  und-'  his  contrc-L  Prefiight  inspection 
should  be  systematically  made  by  crew  members  and  reports  rendered  to  the  pilot. 
Prior  to  everv  training  mission,  the  pilot  will  insure  that  his  aircraft  has  been 
thoroughly  checked  and  inspected  to  include  complete  coverage  of  current  check 
During  every  training  mission,  the  duty  of  the  pDot  will  be  to  supervise  the  func¬ 
tioning  of  each  crew  member  with  a  view  to  developing  individual  skill  and  building 
his  crew  into  an  emdent  combat  team. 

Although  all  of  the  flying  and  technical  ground  training  of  airplane  com¬ 
manders  was  specified  in  considerable  detail,  it  was  frequently  not  possible 
to  maintain  uniformity  of  training  at  the  station  level.  And,  while  some 
attempt  at  least  was  made  to  standardize  flight  procedures,  missions  and 
ground  school  courses,  there  was  very  little  attempt  to  standardize  the  pro¬ 
cedures  to  be  used  in  training  airplane  commanders  in  the  exercise  of  com¬ 
mand  Thus  training  in  accomplishing  the  functions  of  crew  commander 
varied  even  more  than  training  in  pilot  skills.  These  variations  added 
greatly  to  the  difficulties  met  in  carrying  out  research  on  the  proficiency 
of  airplane  commanders.  A  further  discussion  of  these  difficulties  and  of 
the  factors  contributing  to  the  lack  of  uniformity  in  training  conditions  will 
be  given  in  the  sections  of  this  chapter  dealing  with  criteria  of  proficiency. 
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AirfUne  Commander  Check  LlM 

While  flying  skill  was,  of  course,  of  equal  or  even  greater  importance  b  : 
operational  training.  ps>xbo!ogkal  research  ca  the  Job  of  the  airplane  co*.  : 
wander  emphasised  his  activity  as  commander  of  the  crew  rather  that  ! 
the  former.  This  emphasis  had  its  origin  in  the  belief  that  the  former  aspect  j 
of  the  joh  could  best  be  studied  in  connection  with  training  of  the  hxfivfchtf  ; 
pilot  la  the  AAF  Training  Command.  Command  of  the  crew  was  left  to  be 
the  chief  new  or  unique  feature  of  the  activities  of  the  airplane 
In  operational  training.  To  obtain  more  detailed  information  on  the  job 
of  crew  commander,  research  personnel  in  the  Third  Air  Force  made  a 
series  of  direct  observations  of  crew  training.  An  aviation  psychologist  was  \ 
attached  to  a  class  of  combat  crews  at  Avon  Park  AAF  to  make  a  study  of  j 
the  activities  of  the  airplane  commander  in  operational  training.  Ths  j 
officer  flew  18  of  the  26  missions  constituting  the  minimum  requirements,  j 
Several  of  the  missions  were  Sown  more  than  once;  and  flights  were  i 
with  more  than  half  of  the  crews  in  the  dass.  Logs  were  maintained  during 
aO  of  the  flights  which  included  detailed  observations  of  the  activities  of  the 
airplane  commander.  Records  were  also  kept  of  observations  of  the  ere* 
on  the  ground  and  of  conversations  with  crew  members.  On  the  basis  of  j 
this  study,  and  utflulng  the  results  of  other  analyses  and  suggestions,  ai  j 
Airplane  Commande'  Check  List  was  prepared  in  the  Third  Air  Force,  la  j 
this  check  list  were  included  27  items,- each  referring  to  a  training  situation  j 
in  which  it  was  believed  degree  of  success  in  the  exercise  of  command  or  a 
fundamental  pilot  skill  could  be  observed.  In  using  the  check  list,  instruc¬ 
tors  or  other  observers  flying  with  an  airplane  commander  recorded  hh 
effectiveness  in  the  specific  situation  referred  to  in  the  item.  A  copy  of  this 
check  list  is  found  in  the  appendix  G.l.  These  items  may  be  considered  a 
sample  of  the  more  observable  features  of  the  job  of  airplar,*  cotcrander. 

Job  Specifications 

Two  types  of  approach  were  utilized  by  aviation  psychologists  in  arriving 
at  specifications  of  the  characteristics  needed  by  airplane  commanders  for 
success  in  operational  training.  The  first  approach  was  to  collect  and  sum¬ 
marize  the  opinions  of  experts — i.e.  instructors,  combat  returnees,  flight 
surgeons  and  others.  The  second  was  to  study  the  reasons  for  failure  is 
pilots  known  to  have  failed  in  operational  training  as  airplane  commanders. 

Characteristics  Suggested  by  Experts 

The  detailed  procedures  whereby  aviation  psychologists  obtained  from 
instructors,  combat  returnees  and  others  opinions  as  to  characteristics  j 
needed  for  success  in  operational  training  varied  somewhat  in  the  different 
air  forces.  The  relative  emphasis  upon  different  aspects  of  the  job  also 
varied  in  these  interviews,  probably  in  part  depending  upon  current  it- 
search  emphasis.  For  example,  in  the  Secorrl  Air  Force,  approximately  75 
officers  with  combat  experience  in  lead  crew  or  command  position  weft 
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interviewed  ^  attempt  to  discover  what  were  the  most  iopoitiat 
£jUfjctrristic3  needed  for  success  in  lead  crew  position.  While  the  fatter- 
fid* s  were  thus  specifically  oriented  toward  erne  characteristics,  personnel 
interviewed  tended  without  exception  to  describe  what  they  considered  tbs 
post  important  traits  or  characteristics  of  various  crew  members.  Thus  as 
t  by-product  of  interviews  designed  to  obtain  characteristics  of  lead  crews 
there  was  obtained  a  series  of  descriptions  of  what  were  thought  the  most 
ynpofUnt  characteristics  of  successful  airplane  commanders.  In  the  Third 
and  Fourth  Air  Forces  similar  interviews  had  an  entirely  different 
since  they  attempted  to  obtain  direct  descriptions  of  successful  airplane  cam- 
Banders.  In  addition  to  such  interviews,  in  the  Third  Air  Force  the  re¬ 
search  personnel  collected  descriptions  of  situations  in  which  some  airplane 
commander  had  exhibited  either  good  or  poor  proficiency  in  combat.  In  all, 
5t>5  descriptions  of  such  combat  situations  were  obtained.  Also  obtained 
were  about  the  same  number  of  descriptions  of  similar  situations  in  opera¬ 
tional  training.  These  situations  were  sorted  into  categories  by  the  research 
personnel  according  to  trait  or  characteristic  exhibited  by  the  airplane  com¬ 
mander  described. 

From  interviews  with  experts,  from  descriptions  of  situations,  from  study 
of  Training  Manuals  and  Standards  and  from  observations  of  training  the 
following  traits  or  characteristics  seemed  to  research  personnel  in  all  three 
air  forces  the  most  important  for  success  as  airplane  commander.  Included 
are  items  referring  both  to  skills  and  to  aptitude,  personality  and  character. 
The  listing  is  by  no  means  exhaustive;  nor  are  items  necessarily  listed  in 
order  of  importance. 

1.  Skills,  a.  Ability  to  fly  well  in  formation. — Formation  flying  was  felt 
by  most  experts  to  be  the  most  important  feature  of  bombardment  opera¬ 
tions  in  combat.  Aspects  of  formation  flying  that  were  especially  stressed 
were:  smoothness  of  control,  so  that  position  in  formation  was  mairtar  jd 
continuously;  knowledge  of  correct  procedure  in  assembly,  in  formation 
turns  and  evasive  action,  etc ;  and  foresight,  or  ability  to  plan  the  proper 
maneuvers  well  in  advance. 

b.  Ability  to  fly  accurately  on  instruments— In  heavy  and  very  heavy 
bombardment  flying,  instruments  played  a  much  greater  part  in  plane 
operation  than  in  the  case  of  fighter  aircraft,  particularly  in  formation 
flying. 

c.  Knowledge  of  the  aircraft.— Thorough  familiarity  wi‘;i  the  character¬ 
istics  of  the  aircraft  was  necessary  for  accurate  instrument  and  formation 
flying  and  for  early  detection  and  forestalling  of  incipient  emergencies  by 
prompt  action. 

d.  Ability  to  land  and  take  off  with  skill.— Superior  pilot  skill  was  often 
called  for  in  unique  landing  situations.  Since  nearly  half  of  the  aircraft 
accidents  in  operational  training  occurred  in  handling  aircraft  on  the  ground, 
skill  in  landing  and  taking  off  was  probably  more  important  in  operational 
training  and  combat  than  was  ordinarily  admitted. 
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2.  Traits  or  personal  characteristics,  a.  Eagerness  or  enthusiasm .—Ob.  > 
serrations  in  the  Continental  Air  Forces  confirmed  the  belief  that  here,  *s 
wen  as  elsewhere,  motivation  was  one  of  the  most  important  factors  in  job 
success.  Eagerness  and  enthusiasm  accentuated  other  favorable  trails  tad 
made  more  effective  whatever  skills  the  airplane  commander  possessed. 

b.  Good  judgment. — In  interviews  with  experts  the  term  “judgment” 
was  suggested  in  many  different  contexts.  In  general,  the  term  referred  to 
the  making  of  successful  reactions  on  the  basis  of  rapid  evaluation  of  man, 
different  aspects  of  the  immediate  situation.  The  situations  suggested 
varied  from  those  in  which  the  important  features  were  the  spatial  relations 
between  planes  or  between  plane  and  the  ground  to  extremely  complex 
situations  in  which  these  and  other  factors  such  as  degree  of  damage,  fad 
consumption,  crew  injuries  and  the  like  were  considered  in  arriving  at  a 
decision  whether  to  abort  a  mission,  ditch  the  aircraft  or  take  other  ap¬ 
propriate  action. 

c.  Interest  in  other  crew  members. — Since  the  airplane  commander  was 
responsible  in  part  for  training  his  crew,  the  degree  of  interest  he  showed 
in  them  was  reflected  in  the  effectiveness  of  their  training.  Motivation  of 
the  other  crew  members  and  crew  morale  were,  of  course,  directly  influenced 
by  the  interest  of  tbs  airplane  commander  in  them. 

d.  Leadership. — As  was  the  case  with  “judgment”  the  term  “leadership” 

was  used  in  a  variety  of  contexts.  In  general,  it  referred  to  the  over-all 
effectiveness  with  which  the  airplane  commander  handled  the  crew.  Three 
aspects  of  leadership  received  special  emphasis.  The  first  was  willingness 
to  assume  responsibility.  The  attitude  of  “Let  George  do  it”  was  rarely 
found  in  a  successful  airplane  commander.  A  second  aspect  was  the  ability  i 
to  cooperate  with  other  crew  members  in  joint  activities.  Proper  assignment 
of  responsibilities  and  confidence  in  and  proper  evaluation  of  the  contribu¬ 
tions  of  other  crew  members  were  most  important.  Finally,  a  general  over-  j 
all  likeableness  was  recognized  as  important  in  reducing  irritations  between  \ 
crew  members  and  in  keeping  up  crew  morale.  This  also  resulted  in  smooth  j 
relationships  between  crew  and  training  personnel  since  the  airplane  com-  j 
mander  represented  the  crew  in  most  of  these  contacts.  j 

e.  Conscientiousness. — Absolute  accuracy  in  carrying  out  preflight  in-  j 

spections,  exact  following  of  SOP  and  following  without  change  the  exact  j 
briefed  instructions  were  considered  important  in  maintaining  flying  Safety  j 
and  in  successful  accomplishment  of  combat  missions.  I 

f.  Calmness  in  emergencies. — Ability  to  deal  calmly  and  matter-of-factly 
with  emergency  situations  resulted  in  correct  decisions  being  made  by  the  | 
airplane  commander  himself  and  in  the  maintenance  of  good  morale  and  | 
effective  crew  discipline  under  stress  of  combat 

g.  Foresight. — The  ability  to  plan  ahead  and  foresee  the  outcomes  of 
present  situations  enabled  airplane  commanders  to  guard  against  emer¬ 
gencies.  Crew  members  could  be  warned  to  take  appropriate  precautions 
and  smooth  teamwork  achieved  even  in  relatively  sudden  emergencies. 
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Reasons  for  Flying  Evaluation  Board  Action 
Tbf  reports  of  Flying  Evaluation  Board  action  were  analyzed  to  dfah 
cover  if  possible  the  main  reasons  for  failure  in  operational  training.  Data 
were  available  for  33  bombardment  pilots  in  the  Third  Air  Force  and  14 
bombardment  pilots  in  the  Fourth  Air  Force  who  were  re-evaluated  itt 
1944.  Iu  these  analyses  an  attempt  was  made  to  determine  from  each 
Board  Report  the  principal  reasons  for  reclassification  of  the  pilot  coo- 
ce  si.  In  table  4.1  are  given  the  frequencies  with  which  various  categories 
of  reasons  for  re-evaluation  occurred.  The  great  variation  in  material  in¬ 
cluded  in  these  reports  makes  impossible  any  more  detailed  or  meaningful 
analysis  of  the  reasons  lor  failure. 

Tab xx  4.1. — Reasons  for  reclassification  of  pilots  by  FEB  board  action 
PILOTS  RECLASSIFIED  IN  !« <4  IN  THIRD  AND  FOURTH  AIR  FORCES 


Rtiion  for  rcdiuific\tioa 


Relative  Importance  of  Various  Skills  and  Traits 
Two  methods  were  utilized  in  arriving  at  an  estimate  of  the  relative  im¬ 
portance  of  various  skills  and  characteristics  for  success  in  the  job  of  air¬ 
plane  commander.  One  was  through  the  frequency  with  which  the  trait  or 
characteristic  was  mentioned  by  experts  and  the  other  was  through  ranking 
of  the  traits  or  characteristics  by  instructors  and  others. 

1.  Frequency  of  mention  in  situation  descriptions. — The  relative  fre¬ 
quency  with  which  various  skills  and  traits  were  mentioned  in  interviews 
with  combat  returnees,  instructors,  etc.,  was  one  way  of  estimating  their 
degree  of  importance  in  the  job  of  airplane  commander.  This  method  is 
open  to  the  objection  that  frequency  of  mention  in  interviews  may  be 
dependent  more  upon  frequency  of  occurrence  or  ease  of  observing  these 
skills  or  characteristics  than  upon  any  fundamental  importance  in  combat 
or  operational  training.  However,  as  a  matter  of  general  interest,  the  fre¬ 
quency  with  which  various  traits  and  skills  were  mentioned  was  used  in 
the  Second  and  Third  Air  Forces  for  estimating  their  relative  importance. 
Since  the  Second  Air  Force  interviews  were  directed  primarily  toward  obr. 
taining  information  about  lead  crew  proficiency,  frequencies  of  mention  of 
airplane  commander  traits  in  these  interviews  was  probably'  biased  by  that 
emphasis  and  such  data  were  not  included  in  the  discussion  which  follows. 

Research  personnel  in  the  Third  Air  Force  obtained  more  than  500  de¬ 
scriptions  each  of  combat  and  training  situations  illustrating  good  or  poor 
airplane  commander  behavior.  These  situations  were  analyzed  to  determine 
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the  trait*  or  characteristics  referred  to  i&  etch  situation.  The  frequency 
with  which  various  traits  and  skills  appear  in  these  descriptions  is  of  some 
interest,  particularly  the  comparative  frequency  of  mention  for  combat  and 
training  operations. 

Half  of  both  the  training  and  combat  situation  descriptions  referred  to 
skill  in  the  handling  of  emergencies  and  unusual  situations.  When  these 
were  sub-divided  as  to  type,  certain  differences  between  combat  and  train, 
ing  appeared.  Formation  flying  and  handling  of  emergencies  in  bombing 
and  strafing  of  targets  appeared  more  ofter  in  combat  situation  descriptions, 
while  handling  of  mechanical  failure  or  fire  appeared  more  often  in  the 
training  situations.  In  general,  skill  in  routine  flying  was  described  more 
often  in  the  training  situations.  Here  landing  and  preflight  checks  were  the 
most  frequently  mentioned  activities  and  were  also  mentioned  with  greats 
relative  frequen~.y  in  training  than  in  combat  situations.  Strict  adherence  to 
SOP,  maintenance  of  authority,  and  air  and  ground  discipline  were  referred 
to  much  more  often  in  the  descriptions  of  combat  situations  than  in  those 
of  training  situations.  Proficiency  of  the  crew  as  a  whole  and  miscellaneous 
other  characteristics  or  activities  were  mentioned  infrequently  and  occurred 
about  equally  often  in  combat  and  training  situation  descriptions. 

2.  Trait  rating  by  instructors. — In  the  Fourth  Air  Force  research  per¬ 
sonnel  asked  7  or  8  instructors  at  each  of  three  stations  to  rank  10  traits  or 
skills  in  the  order  of  their  importance  for  success  in  operational  training. 
Table  4.2  lists  th**  10  traits  ranked  in  order  of  the  combined  ranking  by  the 
22  instructors  from  the  three  stations,  together  with  the  average  rank  and 
standard  deviation  of  the  ranks  for  each  item.  The  rank-difference  correla¬ 
tion  coefficient  between  the  average  ranks  given  by  the  odd  and  even 
numbered  instructors  was  0.99,  showing  there  was  almost  perfect  agreement 
among  groups  of  instructors  as  to  relative  trait  importance. 

In  addition  to  ranking  the  10  traits  or  skills  each  instructor  at  two  of  the 
stations  rated  his  airplane  commander  trainees  on  each  of  the  10  traits. 
Ratings  were  given  on  the  basis  of  upper  and  lower  half  designations.  The 
instructors  also  gave  a  general  rating  of  over-all  proficiency.  After  the 
ratings  had  been  obtained,  tetrachoric  coefficients  of  correlation  were  com¬ 
puted  to  show  the  degree  of  relationship  between  the  rating  made  oc  each 
separate  trait  and  the  over-all  or  total  rating.  In  this  manner  it  was  ho;>*d 
to  obtain  additional  evidence  as  to  the  relative  importance  of  each  trait  o: 
skill  with  respect  to  total  proficiency.  The  10  traits  were  then  compared  in 
rank  as  given  by  the  instructors  when  they  ranked  the  traits  in  order  of 
importance  and  in  the  degree  of  correlation  between  ratings  of  airplane  '*om- 
manders  on  the  traits  and  ratings  of  total  proficiency.  This  comparison  is 
also  given  in  table  4.2,  Certain  interesting  differences  are  seen  between 
instructors’  beliefs  as  to  trait  importance  and  the  relative  weight  given 
traits  in  arriving  at  a  rating  of  over-all  proficiency.  The  most  striking  dif¬ 
ference  is  in  the  trait  of  “likeableness.”  Instructors  considered  it  £he  trait 
of  least  importance  when  they  ranked  the  traits  in  order  of  importance. 


Howler,  "faen  nit*  tot  ovtr-al!  proficiency  of  the  airplane  com- 
gander  trainees,  apparently  likeableness  played  a  larger  part  than  any 
other  trait.  Similarly,  landing  skill  ’  was  considered  eighth  in  importance 
when  the  traits  were  ranked  but  was  third  in  importance  when  they  rate*? 
their  students.  The  opposite  type  of  relationship  occurred  with  “concern 
with  safety  of  crew.  This  was  thought  third  in  importance  when  the  In¬ 
structors  ranked  the  traits  but  was  eighth  m  importance  in  their  ratings  of 
student*. 

Tmi*  i —Comparison  oj  trait  rankings  with  sizi  of  correlation  betwi ten 
iroit  rating:  and  over-ail  ratings 
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*  The  10  traits  were  naked  by  12  imtroctorj  at  the  above  sUtlona  tad  *t  March  Field. 

’  The  corrdationj  between  trait  and  over-aQ  ratings  were  based  on  ratings  of  16  airplane 
Binders  at  the  above  listed  stations. 


CRITERIA  OF  PROFICIENCY  '  • 

Introduction 

As  with  fighter  pilots  in  chapter  2,  in  this  chapter  on  the  airplane  com 
zander,  and  in  the  following  chapters  on  other  aircrew  specialties,  there  is 
separate  discussion  of  each  major  criterion  of  proficiency  studied.  An  at¬ 
tempt  is  made  in  each  case  to  evaluate  the  criterion  in  terms  of  its  useful¬ 
ness  in  validation  studies  and  other  research.  In  the  discussion  which  fol¬ 
lows,  it  will  be  shown  that  although  the  airplane  commander  was  the  moat 
important  and  probably  the  best  known  crew  member,  it  was  very  dif¬ 
ficult  to  obtain  adequate  criteria  of  his  degree  of  proficiency.  Thus  most  of 
of  the  studies  that  are  reported  dealt  with  various  types  of  ratings  and  other 
subjective  estimates  of  proficiency.  Few  satisfactory  criteria  of  an  objective 
type  were  found  to  be  available. 

Ratings  of  Proficiency 
Over-all  Judgments 

1.  5-pdnt  ratings. — a.  An  obvious  source  of  over-all  judgments  of  profi¬ 
ciency  of  Army  officers  was  the  routine  efficiency  rating  on  WD  AGO  Form 
66-2,  66-3.  Although  knowledge  of  the  way  such  ratings  were  frequently 
^ade  led  to  little  expectation  that  they  would  be  useful,  their  availability 
and  the  absence  of  other  measures  led  to  their  use  in  exploratory  studies. 
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Very  little  evidence  is. available  regarding  the  reliability  of  the  e&daa 
taring*  For  ooe  class  of  52  airplane  commanders  at  AAF  Ardmore  in  & 
Second  Air  Force,  2  efficiency  ratings  were  made  approximately  30  dart 
apart.  While  the  first  set  of  ratings  was  not  consulted  when  the  second  act 
was  made,  the  same  administrative  personnel  were  involved  in  both.  Hetct 
the  corrdatioc  of  0.48  obtai  *d  between  the  two  sets  of  ratings  does  net 
represent  the  reliability  of  truly  independent  efficiency  ratings.  No  other 
data  on  reliability  were  svailatee. 

b.  Very  similar  to  the  efficiency  ratings  on  Form  66-2  were  general  rat¬ 
ings  of  officer  quality  and  teckmcal  still  made  at  another  Secori  Air  Foret 
Station  on  55  airplane  commanders  in  one  class.  The  same  5-fx.-:ct  sat 
was  used  as  for  the  efficiency  ratings.  The  distributions  of  scores  obtained 
were  also  similar  to  those  obtained  with  routine  efficiency  ratings.  No 
direct  evidence  was  available  as  to  the  degree  of  reliability. 

c.  As  part  of  a  project  utilizing  descriptive  ratings  in  the  study  of  UU 
crew  proficiency,  over-all  5-point  ratings  were  made  of  airplane  coes- 
manders  by  ins  true  >  ors  in  the  Second  Air  Force.  A  description  of  the 
scales  used  and  the  procedures  of  administration  is  given  in  the  discussic* 
of  descriptive  ratings  which  follows  in  a  later  section  of  this  chapter.  Tvo 
scales,  A  and  B,  were  used  and  involved  somewhat  different  5-point  rating 
In  Scale  A,  airplane  commanders  were  rated  on  over-all  proficiency  in  tie 
same  categories  as  were  used  in  routine  efficiency'  ratings.  In  Scale  B,  tie 
following  categories  of  proficiency  were  used:  “This  airplane  commander  * 
in  the” — highest  10  percent,  upper  2C  percent,  middle  40  percent,  lower  $ 
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pcttasi  and  lowes*  10  percent.  Distributions  of  atings  obtained  with  both 
J-.W  ire  given  in  table  4  J  above. 

At  a  total  of  4  stations  in  the  Secood  Air  Force,  2  or  more 
rated  each  of  approximate!/  150  airplane  commanders  with  Scale  A,  and 
smdar  rating!  were  made  at  4  more  stations  on  160  airplane 
silk  Scale  B.  The  correlations  bttrttc  ratings  by  different  instructors  ween 
competed  separately  for  each  station  and  combined  by  the  use  of  FMrrt 
r  jBto  a  sjigle  reliability  coefioect  for  each  scale.  The  over-aB  nthy  of 
Kiplanc  commanders  showed  reliabilities  of  0J9  and  0.66  for  Scales  A  and 
b  respectively. 

2.  ifisceUenecxs  relings.—z.  Other  ratings  made  routinely  in  die  Con¬ 
tinental  Air  Forces  daring  1944  were  the  ratings  on  the  Ofcerj  Proficiency 
C  :-j,  AFTRC  Form  2,  a  training  form  accompanying  each  from  the 
AAF  Training  Command  to  operational  training.  At  the  end  of  the  first 
ace*?  of  operational  training,  ratings  were  entered  on  this  form  t«y<V 
with  a  statement  regarding  any  defierccks  in  previous  training  that 

have  been  noted.  Toe  form  was  then  returned  to  the  AAF  Training  Com* 
sand  where  it  served  as  a  sort  of  validation  of  training  ami  as  a  for 
training  revision.  In  practice  the  handling  of  these  forms  was  most  ir¬ 
regular.  They  were  frequently  lost,  ratings  were  cot  entered  properly,  and 
the  forms  rarely  served  any  useful  purpose. 

Three  general  ratings  were  made  on  the  Officers  Proficiency  Card,  one 
each  under  “military  discipline,”  “manner  of  performing  duties,”  and  “gen¬ 
eral  aircrew  ability.”  Each  rating  was  on  a  3-point  scale  of  below  avenge, 
average  or  above  average.  Ratings  of  airplane  commanders  of  3  classes  at 
AAF  Ardmore  were  obtained  on  this  form. 

No  direct  evidence  of  degree  of  reliability  was  available. 

b.  At  Biggs  field  in  the  Second  Air  Force,  flight  surgeons  rated  each  air¬ 
plane  commander  in  one  comb  a:  crew  class  in  terms  of  over-all  proficiency. 
A  3-point  scale  of  below  average  average  and  above  average  was  used.  Nc 
data  bearing  directly  on  reliabiL  '  were  obtained  and  the  flight  surgeon* 
reported  that  their  contacts  with  combat  crews  did  not  give  them  sufficient 
information  to  make  adequate  ratings  of  this  type. 

3.  Rankings. — Another  procedure  for  obtaining  over-all  ratings  of  In¬ 
dividuals  is  to  have  the  individuals  placed  in  an  order-of-merit  series.  In¬ 
structors  at  several  Second  Air  Force  stations  were  asked  to  list  the  airplane 
commanders  they  knew  in  their  current  classes  in  the  order  of  the  expected 
effectiveness  of  these  airplane  commander?  in  combat  The  organization  of 
training  was  such  that  in  practice  each  i;  tructor  usually  knew  only  the 
airplane  commanders  in  a  single  flight  The  lights  varied  in  size  from  one 
station  to  another,  having  from  9  to  28  cre\  At  one  or  two  stations  an 
instructor  was  found  who  felt  he  knew  all  air,  ine  commanders  in  a  dass. 
In  these  cases  the  whole  class  was  ranked  in  a  ingle  list 

Since  size  of  flight  varied,  all  rankings  were  converted  to  equivalent 
standard  scores  for  statistical  studies.  Distributiu.iS  of  scores  were  thus 
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“normal”  and  all  flights  and  classes  had  equivalent  scores  regardless  of  pc* 
able  differences  between  them  in  a  level  of  proficiency.  At  3  of  the  stations 
in  the  Second  Air  Force,  two  or  more  instructors  ranked  the  airplane  coca- 
maDders  in  a  class  more  or  less  independently.  That  is  to  say,  the  actual 
rankings  were  done  independently,  although  the  resultant  rankings  m* y 
not  have  been  truly  independent,  for  there  was  no  control  over  the  extent 
to  which  the  two  instructors  may  have  previously  talked  over  the  relative 
proficiencies  of  the  various  airplane  commanders  rated.  At  two  of  the  three 
stations,  the  independent  rankings  were  by  flights  with  correlations  of  041 
and  0.4$  respectively  between  rankings  by  different  instructors.  At  the 
third  station,  the  whole  class  was  ranked  together  and  the  correlation  be¬ 
tween  rankings  by  two  instructors  was  OJS. 

Descriptive  Ratings. 

1.  Upper  and  Unacr-kalf  ratings  of  traits  and  skills. — From  an  analysis 
of  observations  during  training,  of  interviews  with  training  officers  and 
from  training  manuals  and  the  like,  aviation  psychologists  in  the  Fourth 
Air  Force  obtained  a  list  of  10  traits  or  characteristics  of  airplane  com¬ 
manders  thought  the  most  important  in  operational  training.  A  rating  scale 
was  then  constructed  for  those  items  by  stating  each  trait  or  characteristic 
In  the  form  of  a  question.  The  instructors  were  to  rate  each  trainee  as 
either  above  or  below  average  with  respect  to  each  item,  placing  half  of  the 
trainees  in  each  category.  The  list  of  traits  and  characteristics  has  already 
been  presented  in  table  4.2  above. 

Instructors  at  3  stations  in  tLe  Fourth  Air  Force  were  asked  to  rate  the 
airplane  commanders  whom  they  had  checked  on  training  flights  in  ter  .ns 
of  each  of  the  traits  and  also  in  terms  of  over-all  proficiency.  In  order  to 
minimize  “halo”  effects,  each  item  or  question  was  placed  on  a  separate  sheet 
of  paper  together  with  the  names  of  all  students  in  the  class  or  section.  In 
this  manner  ratings  were  obtained  from  2  or  more  instructors  for  a  tow  ?{ 

55  airplane  commanders  at  2  B-24  Stations.  The  reliability  of  these  ratings 
was  estimated  for  each  of  the  items  by  comparing  the  ratings  given  the 
same  airplane  commanders  by  different  instructors.  Separate  coefficients 
were  computed  for  each  station  and  the  coefficients  combined  by  Fisher’s 
x  to  give  a  single  coefficient  of  reliability. 

Of  the  various  item  ratings,  those  of  “over-all  proficiency,”  “likeable¬ 
ness”  and  "eagerness”  had  a  fairly  high  degree  of  reliability,  the  coefficients 
of  correlation  between  ratings  of  different  instructors  being  0.84,  0.70  and 
0.79  respectively.  (Since  the  ratings  were  in  two  categories  only,  all  co¬ 
efficients  of  reliability  were  based  on  tetrachoric  coefficients  of  correlation). 
Ratings  on  the  remaining  items  had  reliability  coefficients  between  0.41 
and  0.61.  It  is  interesting  that  as  with  other  scales  in  other  air  forces,  tber^ 
was  better  agreement  among  raters  when  they  were  racing  over-all  pro¬ 
ficiency  and  personal  traits  than  when  they  were  rating  specific  skills  and  , 
behavior.  The  crudeness  of  these  ratings  (into  two  categories  only)  anU  the 
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presence  of  the  usual  subjective  errors  make  them  somewhat  less  useful 
than  would  be  Indicated  by  the  reliability  coefficients  obtained. 

1.  Fin- point  retinis  of  letul  crno  proficiency.— AAF  Letter  50-117,  7 
June  1945,  directed  that  aviation  psychologists  In  the  various  Continental 
Air  Forces  cooperate  with  Operatic  ns  and  Training  personnel  in  the  devel¬ 
opment  of  procedures  for  designat  ng  some  of  the  combat  crews  in  each 
CCTS  class  as  potential  had  crews  at  the  end  of  their  operational  training 
no  readily  available  objective  measure  of  crew  proficiency  had  as  yet 
been  found  and  since  it  appeared  unlikely  that  one  would  be  found  in  the 
near  future,  it  was  decided  in  conferences  with  the  research  personnel  con¬ 
cerned  that  three  main  types  of  rating  devices  would  be  developed  and 
tried  out,  one  in  each  of  three  air  forces.  The  three  types  of  devices  and  the 
air  force  of  primary  responsibility  were:  descriptive  ratings  of  lead  crew 
proficiency,  Second  Air  Force;  check  lists  of  behavior  and  traits  important 
in  lead  crews,  Third  Air  Force;  and  ratings  of  mission  performance  at  t 
lead  crew  school,  Fourth  Air  Force. 

In  the  development  of  descriptive  ratings  of  lead  crew  proficiency  in  the 
Second  Air  Force,  the  usual  preliminary  steps  were  taken.  Approximately 
75  officers  and  enlisted  men  with  combat  experience  in  lead  crew  or  com¬ 
mand  positions  were  interviewed  to  obtain  their  opinions  as  to  what  were 
the  most  important  traits  or  characteristics  of  crews  for  success  in  lead 
crew  position.  From  these  interviews  were  obtained  descriptions  of  a  few 
characteristics  applicable  to  the  crew  as  a  whole.  For  the  most  part,  how¬ 
ever,  those  interviewed  described  traits  and  characterstics  of  individual 
crew  members.  It  was  decided,  therefore,  that  in  addition  to  descriptive 
ratings  of  the  crew  as  a  whole,  it  would  be  desirable  to  utilize  descriptive 
ratings  of  individual  crew  members  in  those  characteristics  considered  most 
important  for  lead  crew  success.  On  the  basis  of  the  interviews  and  from 
study  of  lead  crew  training  manuals,  combat  intelligence  reports  and  other 
sources,  a  list  of  the  most  important  crew  and  individual  traits  and  char¬ 
acteristics  was  prepared.  Certain  traits  felt  by  research  personnel  to  be 
non-ratable  for  some  reason  were  discarded  and  rating  scales  were  then 
constructed  (or  the  rating  of  individuals  and  crews  on  the  remaining  traits 
and  characteristics. 

A  number  of  considerations  determined  in  part  the  form  of  the  rating 
scales  decided  upon.  On  the  basis  of  experience  with  descriptive  ratings  in 
civilian  situations,  it  was  felt  that  in  order  to  obtain  optimum  discrimina¬ 
tion  between  individuals  and  crews  it  would  be  desirable  to  have  ratings  on 
from  7  to  x  1  step  intervals  for  each  characteristic  rated.  However,  previ¬ 
ous  analysis  of  routine  proficiency  ratings  by  instructors  and  supervisory 
personnel  had  indicated  that  they  ordinarily  utilized  no  more  than  three 
out  of  five  available  steps  in  making  such  ratings.  Therefore,  5-point  or  5 
step-interval  scales  were  decided  upon  with  the  thought  that  this  would  be 
a  practical  compromise  between  the  usual  three  and  the  ideal  seven  rating 
steps.  It  was  believed  that  with  improved  instructions  and  greater  supervi- 


sioo  of  ratings  all  S  step-intervals  would  be  used  by  the  raters.  As  with 
most  descriptive  rating  scales,  not  only  was  the  trait  or  characteristic  to  be 
rated  described,  but  each  step  or  rating  point  was  described  with  a  brief 
statement  representing  the  typical  individual  to  be  rated  at  that  point 

After  the  decisions  had  been  made  as  to  the  main  traits  and  character* 
istics  to  be  included,  two  separate  and  distinct  rating  scales,  Scale  A  and 
Scale  B,  were  developed  in  the  16th  and  17th  Bombardment  Operational 
Training  Wings  of  the  Second  Air  Force.  Two  scales  were  developed 
(rather  than  a  single  one  for  use  throughout  the  Second  Air  Force)  largely 
for  reasons  of  administrative  convenience.  Because  of  the  need  for  the  im¬ 
mediate  trial  of  some  such  device,  there  was  not  time  for  the  research  per¬ 
sonnel  in  the  two  wings  to  get  together  on  a  single  scale.  Each  gwvp, 
therefore,  developed  a  scale  of  its  own  within  the  framework  of  the  general 
instructions  'ssued.  Thus  Scale  A  and  Scale  B  differed  considerably  in 
certain  features  of  the  scales.  In  Scale  A  the  descriptions  of  the  different 
step  intervals  for  the  rating  of  a  single  trait  or  characteristic  were  quite 
detailed  and,  more  important,  were  almost  identical  in  wording  for  all  the 
step  intervals.  The  difference  between  the  step  intervals  or  rating  points 
was  designated  by  expressions  of  quantity  or  frequency  suck  as  “always,” 
“sometimes,”  “most”  and  “average.”  In  Scale  B,  the  descriptions  of  the 
-  steps  for  the  ratings  on  an  item  tended  to  be  more  brief  and  to  refer  more 
to  specific  bits  of  behavior  thought  by  research  personnel  to  represent  dif¬ 
ferent  degrees  or  amounts  of  the  trait  in  question.  Thus  in  Scale  B  the 
wording  differed  more  from  one  step  or  point  to  another. 

Scales  A  and  B  also  differed  somewhat  in  the  traits  and  characteristics 
included  for  rating  Those  included  for  the  rating  of  the  crew  as  a  whole 
and  for  specialties  other  than  the  airplane  commander  are  described  later 
on  in  the  appropriate  chapters.  For  the  airplane  commander.  Scale  A  in¬ 
cluded  the  following  items:  foresight,  interest  in  his  crew,  proficiency  in 
format  ;  ;o  flying,  proficiency  in  instrument  flying  and  over-all  lead  crew 
proficiency.  Scale  B  included  items  on  proficiency  in  formation  flying, 
eagerness  and  enthusiasm,  foresight  and  planning,  leadership,  proficiency  in 
instrument  flying,  and  two  general  items,  one  on  over-all  lead  crew  profi¬ 
ciency  and  the  other  calling  for  a  ranking  of  the  airplane  commanders  in 
order  of  their  proficiency. 

With  both  scales  mimeographed  blanks  containing  the  descriptive  state¬ 
ments  were  prepared  in  advance.  On  these  blanks  were  typed  the  names  of 
the  individuals  and  crews  to  be  rated.  Instructors  or  training  officers  were 
then  asked  to  rate  each  individual  or  crew  known  to  them.  The  rating  step 
descriptions  were  listed  in  order  from  one  to  five  with  one  representing 
greatest  degree  of  ptoficiency.  The  printed  directions  for  making  the  actual 
ratings  were  identical  for  the  two  scales.  Instructions  were  also  given  that 
different  instructors  rating  the  same  individuals  or  crews  should  not  discuss 
their  ratings  with  each  other.  An  attempt  was  made  with  each  scale  to  ob¬ 
tain  at  least  two  relatively  independent  ratings  for  each  individual  and 
crew  rated. 
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There  was  ooe  additional  difference  between  tbe  iala  as  they  wo* 
K.uoUy  administered.  With  Scale  A  the  actual  making  of  the  ratings  was 
sot  supervised  by  the  research  personnel.  Ia  this  respect  the  ratings  ob¬ 
tained  were  perhaps  similar  to  what  could  have  been  obtained  mere  or  less 
routinely  through  channels,  or  by  mailing  the  to  the  Directors  of 
Training  concerned.  Spot  checks  made  for  that  purpose  showed  that  the  in¬ 
structions  to  avoid  collaboration  in  making  the  ratings  *^re  followed  quite 
wdL  With  Scale  B  tbe  research  personnel  alienated  wherever 
to  actually  be  present  while  the  instructors  were  making  their  ratings.  No 
record  was  kept,  however,  as  to  whether  or  not  a  particular  set  of  ratings 
was  directly  supervised  and  in  some  cases  no  supervision  was  With 

both  soles  instructions  were  given  that  no  ratings  were  to  be  for 
judividuals  and  crews  not  known  to  the  rater.  Complete  copies  of  Scales  A 
and  B  may  be  found  in  appendix  F.l  and  FJ. 

During  the  summer  of  1545,  Scales  A  and  B  were  tried  out  with  a 
cumber  of  B-29  crews  in  both  CCTS  and  OTU  training.  In  the  16th  BOT 
Wing  ratings  were  obtained  with  Scale  A  for  a  total  of  160  crews  at  fotw 
combat  crew  training  stations.  In  the  17  th  Wing  ratings  were  secured  with 
Scale  B  on  between  150  and  700  ur-ws,  approximately  100  of  which  were 
in  OTU  training  at  2  stations,  the  remainder  being  in  CCTS  training  at  2 
other  stations.  The  distributions  of  the  sums  of  the  item  ratings  of  airplane 
commanders  obtained  with  the  two  scales  are  given  in  table  4.4.  It  can  be 
seen  that  with  both  scales  there  was  good  dispersion  of  the  totals  of  the 
item  ratings. 

Table  4.4. — Disf'lbution  of  airplane  commander  ratings 


SCALES  A  ANT)  B.  SECOND  AIK  POBCK 
Scale  A,  5  Items  Scale  B,  7  Items 
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320 

Total  . 
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Mean  . . . 

12  20 

Mfsn  . . . 
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SD . 

.  2.97 

SD . . 

The  reliabilities  of  the  ratings  given  for  jach  airplane  commander  trait 
or  characteristic  are  shown  in  table  4.5.  T'.i  coefficients  given  in  the  table 
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ik  «K»  iKnjts  (by  Fisher’s  a)  of  the  conditions  obtiiwd  *t  the  &. 
ferest  stations  between  ratings  oi  the  same  airplane  commanders  by  t*» 
different  instructors.  The  variations  in  reliability  from  station  to  *i?(io* 
are  iDnstrated  in  the  reliabilities  of  the  total  ratings  on  all  items  which 
shown  for  each  station  separately  in  table  4i. 
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Table  4.6.— RdiMBty  •/  joofe  K»rei  for  ak  flame  commaaien 
SCALE  A  AND  I.  SECOKD  AOt  FOftCZ 
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It  is  rather  interesting  that  with  the  airplane  commanders  as  well  as  with 
the  other  specialties  and  with  the  crew  as  a  whole,  the  correlations  between 
the  ratings  of  the  same  individuals  by  different  instructors  are  somewhat 
higher  for  over-ail  ratings  than  for  ratings  on  specific  traits  or  character¬ 
istics.  This  is  shown  by  the  fact  that  for  Scales  A  and  B  the  averages  of  the 
item  reliabilities  for  the  specific  traits  or  characteristics  (taking  all  crew 
positions  and  the  crew  as  a  whole  were  0.38  and  0.42,  while  the  average* 
of  the  item  reliabilities  for  the  over-all  and  genera!  ratings  (all  crew  posi¬ 
tions  and  crew  as  a  whole)  were  0.46  and  0.53  respectivdy. 

The  intercorrelations  bei  ween  ratings  of  the  airplane  commanders  on  the 
different  traits  and  ch?  acteristics  of  the  scale  are  shown  in  table  4.7.  In 


gej^ral  ratings  of  interest  m  crew,  of  eagerness  and  of  instrument  flying 
ygao  to  have  less  in  common  with  the  total  set  of  ratings  than  do  ratings  of 
lie  other  traits.  As  might  be  expected,  the  over- all  or  general  ratings  tend 
have  the  most  in  common  with  the  rest  of  the  ratings.  However,  the 
differences  are  not  large  and  a!l  items  have  a  great  deal  in  common  with 
the  rest 
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Airplane  Commander — Scale  B  * 


3.  Interview  board  ratings. — At  one  station  under  the  16th  BOT  Wing 
in  the  Second  Air  Force  aviation  psychologists,  training  personnel  and  mem¬ 
ber-  of  the  Base  Standardization  Board  cooperated  in  a  special  attempt  to 
improve  the  estimation  of  the  degree  of  proficiency  of  crew  members  com¬ 
pleting  operational  training  at  that  station.  The  Standardization  Boards 
were  interested  in  this  problem  because  they  had  the  mission  of  seeing  to 
it  that  flight  procedures  taught  in  operational  training  conformed  to  all 
'•nny  Air  Forces  directives.  They  also  had  the  responsibility  of  checking 
on  the  performance  of  aircrew  trainees  to  see  that  they  were  familiar  with 
the  standard  flight  procedures  and  flying  regulations.  After  some  discus¬ 
sion,  it  was  decided  to  interview  each  aircrew  officer  completing  operational 
train-’. -g  m  a  current  class  and  on  the  basis  of  the  interview  and  all  other 
•bailable  data  rate  him  on  each  of  several  traits  considered  important  for 
success  in  combat.  An  interview  board  was  therefore  set  up  consisting  of  a 
member  of  the  Base  Standardization  Board,  an  instructor  of  the  specialty 
of  the  trainee  being  interviewed  and  an  aviation  psychologist.  This  board 
interviewed  each  airplane  commander,  copilot,  navigator  and  bombardier 
completing  operational  training  in  a  current  class. 

No  set  routine  was  established  for  the  interview  and  the  questions  asked 
differed  from  one  interview  to  another,  although  they  were  naturally  di- 
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reeled  toward  information  related  to  the  ratings  to  be  made.  After  the 
Interview,  the  boards  rated  each  trainee  r.~t  a  10-point  numerical  scale  o« 
each  of  the  following  traits:  interest  in  flying,  desire  for  combat,  capacity 
to  make  decisions,  getting  along  with  others,  educational  background,  and 
officer  qualities.  Decision  as  to  the  rating  for  a  trainee  on  a  particular 
trait  was  arrived  at  by  consensus  of  board  members.  Where  agreement  was 
not  reached,  the  average  of  separate  ratings  by  the  different  board  members 
was  used.  AD  available  data  from  the  Training  Department  were  used  b 
arriving  at  the  rating  as  well  as  the  impressions  gained  from  the  interview. 

The  in tercorrela lions  between  the  ratings  given  by  the  Interview  Board 
to  51  airplane  commanders  on  the  ~bove  6  traits  are  shown  in  table  4.7. 
The  surprising  feature  of  these  intercorrelations  is  the  number  of  negative 
relationships  rhown,  some  of  which  are  rather  high.  Although  there  was  no 
definite  evidence,  it  was  suggested  that  the  procedure  of  discussing  each 
trait  rating  among  the  board  members  led  to  a  greater  degree  of  independ¬ 
ence  among  the  trait  ratings,  perhaps  even  to  the  extent  that  a  high  rating 
was  given  individuals  in  their  most  characteristic  traits  while  low  ratings 
were  given  in  the  remaining  traits. 


Taux  4.8. — Correlations  between,  interview  board  ratings  of  six  traiis 
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Since  there  seemed  to  be  no  simple  way  of  estimating  the  de  cree  of  re¬ 
liability,  no  such  data  were  reported  for  the  Interview  Board  ratings. 

4.  Mutual  ratings. — As  a  part  of  the  project  in  which  aircrew  officers 
completing  operational  training  at  one  of  the  stations  in  the  Second  Air 
Force  were  rated  by  an  Interview  Board,  each  aircrew  officer  was  asked  to 
rate  every  other  aircrew  officer  on  bis  crew  on  the  following  traits:  interest 
in  flying;  desire  for  combat;  capacity  to  make  decisions;  getting  along  with 
others;  educational  background;  and  officer  qualities.  Each  trait  rating  was 
made  on  a  10-point  numerical  scale,  1  being  a  poor  rating  and  10  the  best 
rating.  No  data  on  reliability  were  reported. 

Mission  Ratings 

Early  in  1945  there  was  organized  at  Muroc  AAF,  California,  a  Lead 
Crew  School  under  the  joint  supervision  of  the  21st  Bomber  Command  and 
the  Fourth  Air  Force.  Crews  thought  outstanding  in  combat  in  the  2 1st 
Bomber  Command  were  sent  back  to  this  school  for  special  training  for  re¬ 
turn  to  combat  as  le  .d  crews.  Believing  that  this  school  would  afford  an 
unusual  opportunity  !o  obtain  information  on  lead  crew  proficiency,  re- 
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search  personnel  of  the  Fourth  Air  Force  spent  considerable  time  observing 
training  procedures,  conferring  with  training  personnel  and  studying  avail* 
able  measures  of  crew  proficiency.  Two  main  types  of  measures  of  pro^ 
geienev  were  found  to  be  available.  These  were  mission  grades  and  ratings, 
and  radar  bombing  scores.  The  latter  are  discussed  briefly  In  a  later  section 
0f  this  chapter,  while  a  much  more  complete  discussion  is  given  in  chapter 
7 f  Bombardier. 

After  preliminary  studies  of  mission  grading  and  some  discussions  with 
training  personnel,  aviation  psychologists  in  the  Fourth  Air  Force  were 
asked  to  collaborate  with  the  training  personnel  at  the  Lead  Crew  School  In 
the  development  of  more  adequate  procedures  for  assessing  the  skill  of  ft 
crew  in  accomplishing  a  mission.  As  a  result  of  conferences  and  discussions 
scales  were  developed  for  rating  each  aircrew  officer  on  each  important  ac¬ 
tivity  he  performed  on  a  mission.  In  these  scales,  the  instructor  making  the 
observations  was  supposed  to  record  a  rating  of  from  1,  meaning  “poor” 
to  5  meaning  “excellent”  for  each  of  the  mission  activities  on  mission  grad¬ 
ing  blanks  provided  'or  the  purpose.  There  was  a  similar  5-point  rating  of 
over-all  mission  periormance.  In  general,  each  trainee  officer  was  rated  by 
an  instructor  of  his  own  specialty.  In  addition,  each  of  the  instructors  In 
the  different  specialties  made  a  5-point  over-all  rating  of  the  performance 
of  the  crew  as  a  whole. 

In  practice,  it  was  not  possible  to  obtain  ratings  of  all  ciew  members  on 
all  missions.  However,  during  the  course  of  training  at  the  Lead  Crew 
School,  it  was  usually  possible  to  secure  at  least  6  mission  ratings  for  each 
aircrew  specialty.  Usually  a  different  instructor  flew  with  a  crew  on  each 
different  mission,  although  occasionally  an  instructor  might  fly  more  than 
once  with  the  same  crew.  Where  an  instructor  repeated  a  rating  on  any 
crew,  that  rating  was  discarded  in  the  statistical  analyses  of  reliability. 
Thus  all  comparisons  between  odd  and  even  mission  ratings  represented 
observations  by  different  instructors.  Reliability  coefficients  were  obtained 
by  comparing  the  averages  of  the  ratings  for  odd  and  even  missions  In 
general  each  mission  blank  yielded  two  scores.  One  was  the  total  of  the 
ratings  on  the  separate  activities  of  the  mission  and  the  other  was  the 
over-all  rating  of  the  individual  on  that  mission.  Table  4.9  presents  the 
data  on  the  reliability  of  the  ratings  of  the  airplane  commanders.  Data  far 
the  crew  as  a  whole  and  for  the  other  aircrew  specialties  are  given  m  later 
chapters.  Copies  of  the  scales  used  in  these  mission  ratings  are  given 

appendix  D.l. 


Table  ^.-Odd-even  mission  reliability  of  mission  ratings  of  airplane  commanders 
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Proficiency  Check  List  Ratings 

I.  Crna  proficiency  check  (VHB). —Descriptive  ratings,  ratings  of  mis* 
lion  performance,  and  ratings  on  pioficiency  check  lists  are  of  course  not 
necessarily  mutually  exclusive.  Frequently  parts  of  one  device  are  quite 
similar  to  part  or  all  of  others  of  different  types  in  terms  of  format,  type  of 
trait  or  characteristic  rated,  etc.  In  this  sense,  the  Crew  and  Airplane  Com¬ 
mander  Proficiency  Checks  developed  in  the  Third  Air  Force  contained 
some  items  that  were  much  like  items  on  the  Scale  for  Rating  Mission 
Performance  in  the  Fourth  Air  Force.  However,  the  main  emphasis  in  the 
two  types  of  devices  was  rather  different.  In  the  Scale  for  Rating  Mission 
Performance  in  the  Fourth  Air  Force,  the  instructors  were  called  upon  to 
rate  on  a  5-point  scale  each  of  the  most  important  activities  of  the  crew 
member  rated  on  that  particular  mission.  In  the  Proficiency  Checks,  the 
instructor  was  called  upon  to  check  the  presence  or  absence  (or  sometimes 
the  amount  of)  certain  items  of  behavior  during  the  mission  rated.  This 
distinction  is  important  and  will  be  discussed  further  in  the  evaluation  of 
the '  {rious  criteria. 

A  b  eat.  deal  of  time  and  effort  went  into  the  development  of  the  Crew 
and  Airplane  Commander  Proficiency  Checks  in  the  Third  Air  Force.  In 
order  to  obtain  firsthand  information  on  the  activities  performed  by  the 
various  crew  members  on  the  different  missions,  a  research  officer  was  at¬ 
tached  to  a  CCTS  class  zt  one  of  the  training  stations  of  the  Third  Air 
Force.  This  officer  flew  each  of  the  main  types  of  required  training  missions 
at  least  once.  As  was  described  under  Job  Analysis  in  this  Chapter,  detailed 
records  were  maintained  of  all  observable  activities.  Also  studies  were  made 
of  material  obtained  from  conferences  with  instructors,  analyses  of  training 
manuals  and  descriptions  of  training  and  combat  situations  where  significant 
airplane  commander  performance  was  thought  to  have  been  demonstrated. 
From  all  of  these  sources  were  obtaired  items  of  behavior  of  airplane  com¬ 
manders  on  combat  type  missions  which  were  thought,  to  be  both  observable 
and  important  in  indicating  degree  of  proficiency.  In  constructing  the 
check  list,  if  possible,  each  item  was  set  up  in  such  a  form  that  tbs  observer 
merely  made  a  check  mark  as  to  the  presence  or  <■  ssence  of  the  particular 
behavior  on  the  mission  being  rated.  However,  <**n  important  aspects  of 
mission  performance  did  not  lend  themselves  to  ri.  s  type  of  report.  Thus 
on  some  items  the  instructors  were  asked  to  estimate  the  frequency  or 
quantity  of  some  particular  activity  observed.  With  other  items,  the  instruc¬ 
tors  were  called  on  for  a  rating  of  the  goodness  or  poorness  of  the  behavior 
observed. 

In  this  manner  two  check  lists  were  developed  by  research  personnel  in 
the  Third  Air  Force.  The  first,  a  preliminary  form  of  an  Airplane  Com¬ 
mander  Check  List  (B-24),  was  completed  early  in  1945.  It  was  never 
used,  however,  since  at  that  time  the  development  of  a  check  list  for  B-29 
lead  crew  proficiency  was  given  a  h'^her  priority. 

The  Crew  Proficiency  Check  (V'.tB)  grew  out  of  the  earlier  Airplane 
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Commander  cneck  List  (B-24).  Items  for  the  latter  were  revised  to  ft 
the  B-29  training  program  and  additional  items  were  constructed  cover¬ 
ing  the  most  important  activities  of  crew  members  other  than  the  airplane 
commander.  Even  in  its  final  form,  however,  the  Crew  Proficiency  Check 
(VHB)  included  a  large  proportion  of  items  referring  mainly  to  activities 
of  the  airplane  commander,  for  22  of  the  49  check  list  items  were  ci  this 
type.  Thi3  preponderance  of  airplane  commander  items  was  perhaps  not 
undesirable  in  a  device  set  up  for  the  rating  of  crew?  as  potential  lead  atw 
material,  since  the  airplane  commander  was  universally  regarded  as  the 
most  important  person  os  the  lead  crew.  In  addition  to  the  49  check  list 
items,  there  were  included  2  general  item*,  I  railing  for  an  over-all  5-point 
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rating  of  the  airplane  commander  and  the  other  for  a  similar  rating  of  the 
crew  as  a  whole. 

The  final  form  of  the  Crew  Proficiency-  Check  (VHB)  was  administered 
to  175  B-29  crews  in  training  at  4  Third  Air  Force  Stations  during  the 
period  from  5-15  August  1945.  The  check  was  administered  to  all. crews 
with  whom  an  instructor  pilot  rode  during  this  period,  regardless  of  mtgann 
or  phase  of  training  of  the  crew  concerned.  None  of  the  crews  was  rated 
more  than  once  so  that  it  was  not  possible  to  obtain  an  adequate  estimate 
of  the  reliability  of  these  ratings.  It  had  been  planned  that  additional  mis¬ 
sions  for  each  crew  would  be  rated  by  an  instructor  other  than  the  one 
making  the  original  rating.  Cessation  of  training  after  VJ-day  made  this 
impossible. 

A  scoring  key  was  prepared  for  the  Crew  Proficiency  Check  (VHB)  by 
asking  experienced  personnel  to  rate  the  different  alternatives  to  each  item 
in  terms  of  degree  of  proficiency  represented.  With  minor  changes  on  the 
basis  of  material  in  training  manuals  and  directives,  these  ratings  were  used 
to  derive  weights  of  0,  1,  2,  or  3  for  each  alternative  under  each  item  of 
the  check  list.  Table  4.10  gives  the  means  and  standard  deviations  of  the 
total  scores  on  the  check  list  for  crews  at  each  of  the  four  stations  where  it 
was  administered  and  where  complete  data  were  obtained. 

Although  a  satisfactory  estimate  of  reliability  was  impossible  since  the 
proficiency  check  was  administered  only  once  for  each  crew,  an  analysis 
was  made  of  the  consistency  of  the  item  scores  for  a  single  mission.  A 
coefficient  of  internal  consistency  was  computed  by  correlating  the  scores 
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obfihrd  with  2  sets  of  14  iteso  ritrtd  by  tie  »oidk  pm— rt  as  c%. 
parable  la  foraat  sad  Kociaf.  Tie  tacetudri  coeSdeat  was  0-57.  WVq 
thb  is  corrected  by  tie  Spcansaw-Bsoww  formula,  tie  eqabaSeat  niHU  i^ 
lor  tie  total  scale  of  49  item  wood  be  0A2.  It  Aedd  be  f  aaphasiaed  ipj 
list  tkb  is  tie  coosbteacy  of  a  single  observers  ratals  of  perforraace  oa  a 


2.  Instntment  scnle  (B-17). — Another  device  wiki  attempted  to 
obtain  aa  objective  twhatia  ef  p3oi  pro6dency  was  a  scale  for  measarr- 
inf  instnasaect  flying  sk£  dntkpcd  by  jralios  psyddofstt  is  tie  Tfc®4 
Air  For  ce.  This  device  consisted  of  a  check  hst  which  covered  tie  banc 
maneuvers  of  tie  »^Je  card  instrument  check,  as  outimed  in  AA F  Rr^h- 
tut  50-3  (15  October  1943).  No  items  were  iaduded,  however,  for  tie 
radio  porticos  of  the  tastnsneni  check.  Several  types  of  items  were  m- 
cluded  in  the  scale:  quantitative  items  in  which  the  observer  checked  sack 
matters  as  of  hank,**  “time  taken  to  attain  a  given  change  la 

airirade”  during  a  specific  maneuver,  etc.;  check  list  items  in  which  the  ob¬ 
server  checked  whether  the  pilot  did  or  did  not  perform  a  certain  act,  sack 

as  ‘■'Trimmed  plane— Yer -  No———”;  and  rnisceflancous  ratings 

invoking  judgments  of  the  quality  of  certain  specific  activities  of  the  pilot 
which  did  not  lend  themselves  to  quantitative  description.  A  copy  of  tie 
Instrument  Flying  Scale  (B-17)  is  given  in  appendix  E.1. 

A  preliminary  form  of  the  scale  was  administered  by  check  pilots  to  60 
trainee  pilots  in  the  course  of  a  routine  white  card  instrument  check.  Item 
revisions  were  then  made  in  the  light  of  answers  given  by  pilots  with  high, 
medium  and  low  total  scores  on  the  scale.  The  depleted  scale  was  ad¬ 
ministered  to  4  groups  of  pilots:  6  instrument  check  pilots;  19  flying  in¬ 
structors;  23  ground  instructors,  who  were  also  pilots;  and  20  combat  crew 
trainee  pilots.  The  differences  between  scores  given  pilots  in  the  different 
groups  were  in  the  expected  direction  with  the  trainees  receiving  the  lowest 
average  score  of  160  and  the  instrument  check  pilots  receiving  the  h«ghe<f 
average  score  of  177.  The  difference  between  the  averages  for  these  ex¬ 
treme  groups  was  significant  at  the  1  Descent  leveL 

Each  of  the  six  instrument  check  pilots  was  scored  on  the  'instrument 
flying  scale  on  five  different  occasions  by  each  of  two  fellow  check  pilots. 
One  of  these  observers  remained  the  same  fer  all  five  missions.  The  other 
observer  was  a  different  check  pilot  in  each  case.  The  average  deviation  of 
scores  per  check  pilot  was  5.6  when  a  different  rater  scored  the  five  missions. 
When  the  same  observer  scored  all  missions,  the  average  deviation  was  53. 
The  dosing  down  of  B-17  training  prevented  the  use  of  the  scale  with 
larger  groups  of  trainees.  Thus  no  adequate  data  on  reliability  are  available. 

Self  Bating* 

Trait  Rat  in  p  , 

Airplane  commanders  of  one  class  of  B-Z4  crews  at  a  Second  Air  Force 
Station  were  a.ked  to  rate  themselves  on  each  of  the  following  traits:  in¬ 
terest  in  flyinp  desire  for  combat;  capacity  to  make  decisions;  getting 
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^eeg  with  others,  nhatioeal  bd^ad;  id  o&a  qvltkl  TW  nl> 
«ee  ra<V  ca  IO-poist  sssexi]  scales  whh  I  reproeatb^g  *  rtti^ 
gal  vis  i*?x  and  *0  representing  the  best  possible  raring.  Nc  oa  i*« 
£^Ktr  weie  arailabk. 

la  ccecedioc  with  descriptive  ratings  of  kad  crew  proficiency  «UaM 
a  ibe  Secood  Air  Force,  tbo?  were  trcioded  of  b!«ot  k  Iea4 

qH  issigaBKot  Tbcse  ratings  were  cfcuiatd  la  aa  cAort  to  jtcst  sKKO 
jporr*?***1  iboot  the  stie^il  of  ootinixa  of  the  different  crews  sad  tut 
uobei  As  with  the  descriptive  ratings  by  instructor!,  the  statana** 
jsed  with  the  se*T  ratings  differed  cccsiderakly  with  Scales  A  and  B,  the 
j*o  descriptive  scales  used. 

The  seif  ratios  obtained  frees  airpiase  cogsgaroders  ud  ether  crew 
g^cbers  in  cocnectioo  with  zdaunistratioa  of  Scale  A  were  in  the  form  of 
rse^poect  ratings  under  each  of  several  dinerest  statements  regarding  degree  • 
af  interest  in  lead  crew  assignment.  la  contrast  to  the  rest  of  Scale  A,  the 
n^Z  oi  om  repress  ted  little  interest  and  that  o?  fiw,  most  interest.  AT 
there  were  seven  statements  in  aB,  data  were  analyzed  jtuf  oe  die 
•irce  foSowing  statements:  ‘‘Ho**  interested  are  yon  in  br'-.g  a  member  of 
»  had  crew?”  “How  interested  are  you  in  having  your  crew  become  a  lead 
ctrm?77  and  “How  interested  is  your  crew  in  becoming  a  lead  crew?"  As 
yy-yt  fee  expected  there  was  a  high  degree  of  similarity  in  the  answers  of 
*3  crew  members  to  the  three-  different  statements.  For  the  last  2  erf  the  3 
statements  given  above  the  correlations  between  ratings  ranged  from  0.67  * 

to  GJJO  for  the  different  crew  members  oi  156  B-29  crews.  These  coe&ients 
probably  represent  an  even  higher  degree  of  correspondence  than  indicated 
by  their  size,  since  the  distributions  o?  self- ratings  were  decidedly  skewed. 
This  is  evidenced  by  the  fact  that  the  mean  ratings  were  usually  between 
toor  and  five  ca  a  five-point  scale,  with  standard  deviations  faffing  at  about 
one. 

With  descriptive  rating  Scale  B  in  the  Second  Air  Force,  a  somewhat 
different  seif-rating  of  interest  in  lead  crew  assignment  was  obta  ned.  De¬ 
gree  of  interest  wat  represented  by  ratings  on  a  scale  running  from  one,  for 
title  or  no  de^re,  to  nine,  for  exceptionally  strong  desire  for  lead  crew 
assignment  With  Scale  B  the  airplane  commander  rated  only  the  strength 
of  desire  jf  his  crew  rather  thar.  that  of  himself.  The  other  crew  members 
rated  'ueir  own  desire  for  the  assignment 


i  ir plane  Commander  Questionnaires 

Another  type  of  self-rating  was  that  obtained  from  a  paper  and  pencil 
inventory  or  questionnaire  in  which  the  individual  described  bis  own  be¬ 
havior.  In  connection  with  the  development  of  procedures  for  the  designa¬ 
tion  of  certa-c  airplane  commanders  as  potential  lead  crew  material,  avia¬ 
tion  psychologists  in  the  Third  Air  Force  developed  such  a  questionnaire. 
In  it,  airplane  commander  trainees  were  asked  to  designate  which  of  various 
types  of  behavior  they  customarily  used  in  dealing  with  their  crews.  Much 
previous  research  and  background  material  obtained  from  conferences  with 
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experienced  ptnowd  ns  utHixrd  ic  the  coostractJoa  of  Utas  (or  the  qn. 
tmuiit  A  prdimmiry  fora  ns  draws  sp  aad  administered  to  89  air. 
plane  commanders  at  1  statka  in  the  Third  Air  Force  in  June  1945.  C« 
the  basis  of  the  results  from  this  administrafxs  the  scale  was  revised  and 
a  final  form  coataaang  40  items  was  constructed.  This  form  was  aAwgj) 
tend  to  175  airplane  commander  trainees  at  4  heavy  bombardment  station. 

To  obtain  a  scoring  key,  the  research  personnel  consulted  training  per. 
soood,  training  directive  and  manuals  to  obtain  informatiOQ  on  the  basis 
of  which  they  gave  an  arbitrary  weight  to  each  alternative  (or  every  item. 
The  scores  obtained  with  this  key  (or  the  Airplane  Commander  Question¬ 
naire  are  shown  ic  table  4.11  for  airplane  coaunac-iets  at  each  of  4  sta¬ 
tions.  The  internal  consistency  or  reEabflity  of  the  scores  on  the  question¬ 
naire  was  <k  ennined  by  an  analysis  of  the  answers  to  the  items,  according 

to  the  K oder- Richardson  formula.  rlt  =  — —  •  ,  the  codB- 

n— I  *ti 

oents  so  obtained  also  being  given  in  the  table.  It  can  be  seen  that  the 
device  Lad  a  moderate  degree  of  internal  consistency.  A  copy  of  the  ques¬ 
tionnaire  is  given  in  appendix  C.1. 


Tuu  4.11. — Scons  m  mrfiome  commander  qnesticmnmn 
*~Z9  CREWS — THIRD  SIX  FORCX 
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Rate  of  Training  Aecompfiahmert 

One  of  the  most  important  ways  of  estimating  still  or  proficiency  of  u 
individual  or  group  is  to  measure  the  output  per  unit  of  time.  Although 
this  type  of  measure  was  Dot  obviously  and  easily  available  in  reference  to 
the  main  objectives  of  operational  training,  reports  of  instructors  and  train¬ 
ing  personnel  indicated  a  belief  that  the  more  skillful  and  prof,  dent  crews 
tended  to  accomplish  their  training  requirements  mor^  quickly  i'-.an  less 
proficient  crews.  The  outstanding  crews  were  described  as  “efficient  they 
get  things  done.”  Such  crews  “breezed  through  their  training.”  Commc-.ts 
such  as  these  suggested  that  the  rate  at  which  a  crew  accomplished  its  mi- 
sions  might  be  a  useful  indication  of  its  proficiency  in  operational  training. 

Early  in  1944,  more  or  less  standard  training  procedures  and  procedures 
for  reporting  training  progress  were  set  up  in  all  of  the  Continental  Air 
Forces.  It  became  possible  theo  to  estimate  j  ither  easily  the  rates  at  which 
different  crews  were  completing  their  requir  men  Is  in  operational  training. 
Thus  research  personnel  of  the  Second  .Air  Fc  xe  were  able  to  make  detailed 
analyses  of  training  accomplishment  from  tl  e  reports  of  training  progress 
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cs  Form  A  301,  Crew  Progress  Chan— Flying  Training.  This  dart  con¬ 
tained  separate  sections  for  recording  training  accomplished  l&  each  o!  the 
nais  phases  of  training.  ( B  1 7  and  B-24  training  had  three  pbaits,,  white 
B-29  training  was  divided  into  two  phases,  with  the  charts  d&edng  ac¬ 
cordingly)-  Another  section  was  provided  for  recording  the  gf^Yffrydhh- 
nefit  of  the  AAF  Training  Standards  requirements.  Each  settles  contained 
squares  or  spaces  for  recording  boors  down  as  wefl  as  the  specific  require¬ 
ments  completed,  each  square  representing  5  boors  of  dying  by  the  crew 
concerned.  When  a  crew  completed  a  particular  the  appropriate 

square  or  squares  representing  that  mission  and  the  particular  requirements 
involved  were  blacked-in  opposite  the  number  designating  that  crew. 
Similarly  the  boors  Sown  were  entered  by  blacking-in  the  appropriate  num¬ 
ber  of  squares.  By  examining  the  charts  for  any  particular  date  it  was  pos¬ 
sible  to  determine  very  quickly,  either  for  a  single  crew  or  for  a  class  as  a 
whole,  the  number  of  missions  and  requirements  completed,  number  of 
hours  Sown,  etc. 

Great  difS  ulty  was  encountered  as  scon  as  an  attempt  was  maiir.  to 
estimate  the  reliability  of  mission  accomplishment  scores  obtained  from  the 
crew  progress  charts.  Operational  training  was,  in  a  way,  a  series  of  unique 
events.  Missions  differed  from  each  other  and  different  phases  of  training 
represented  quite  different  tasks.  The  different  phases  of  training  were 
carried  on  both  concurrently  and  seriatim.  In  general.  Phase  I  training  was 
basic  and  dealt  with  checking  out  the  individual  crew  members  in  their 
specialties.  Hence  this  phase  ten  „  to  be  completed  early  in  training. 
However,  long  before  a  crew  completed  all  of  Phase  I  requirements  it  began 
to  fly  missions  in  Phase  II,  and  in  B— 17  and  B—24  training,  missions  of 
Phase  HI  as  well.  Furthermore,  the  particular  order  in  which  missions  were 
flown  within  each  phase  varied  greatly  from  crew  to  crew.  Actually  the 
situation  was  such  that  although  the  order  of  accomplishment  of  missions 
varied  greatly  this  order  was  not  a  chance  matter  and  could  not  be  treated 
statistically  as  if were. 

There  were.  A  course,  a  great  many  uncontrolled  variables  that  affected 
the  amount  jf  training  accomplished  bv  a  crew  during  a  given  period  of 
training,  some  of  these  factors  were  specific  to  the  crew.  An  example 
would  bi  illness  of  one  or  more  of  the  crew  members.  Others  were  charac- 
terist"-  of  a  particular  class.  Examples  would  be  shortages  of  equipment 
ar.'  limitation  of  flying  due  to  bad  weather  and  the  like.  Still  others  were 
.  obably  characteristic  of  the  station.  Such  a  factor  would  be  a  policy  on 
the  part  of  a  training  department  to  require  all  crews  to  fly  certain  mis¬ 
sions  during  a  particular  week  of  training.  Whatever  the  reasons,  there 
were  certainly  wide  differences  in  amount  of  training  accomplished  in  a 
given  period  of  time  by  crews  in  different  CCTS  classes. 

The  crew  progress  reports  given  the  most  detailed  analysis  in  the  Second 
Air  Force  were  those  for  B-17  and  B-24  crews  showing  the  training  accom¬ 
plished  at  the  end  of  the  sixth  week  ci  training.  The  end  of  the  sixth 
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week  ns  chases  lor  this  analysis  since  at  that  time  most  crews  had  tv\* 
completed  Phase  I  training,  while  at  the  same  time  a  substantial  nuralxv  cf 
requirements  in  Phase  II  and  Phase  III  had  usuaPy  been  accomplish^. 
The  analysis  included  data  for  all  crews  in  24  CCTS  (B-17  and  B— 24} 
at  10  different  stations.  The  average  number  oi  training  require¬ 
ments  (total  for  afi  phases)  completed  per  class  ranged  from  76  to  108, 
with  standard  deviations  cf  from  33  to  7.8.  The  total  requirements  at  the 
time  of  «hi<  study  cumbered  127  as  scored  on  the  crew  progress  charts. 
Thus  the  mean  percent  of  requirements  completed  at  the  end  of  the  sixth 
week  ranged  from  60  to  84  for  the  classes  studied.  These  percentages 
present  a  somewhat  distorted  picture  of  the  condition  of  training  at  that 
time.  Actual!;  the  requirements  completed  first  were  usually  those  most 
easily  and  quickly  gotten  out  of  the  way.  Those  remaining  tended  to  be 
requirements  that  would  take  the  most  time  and  be  most  difficult  to  ac¬ 
complish. 

The  result  of  all  this  is  that  there  was  no  simple  statistical  procedure  for 
estimating  the  reliability  of  mission  accomplishment  scores.  Three  different 
ways  of  estimating  this  reliability  were  explored.  First,  there  were  com¬ 
pared  the  numbers  of  missions  accomplished  at  the  end  of  6  weeks  cf  train¬ 
ing  under  each  of  the  three  phases  of  training.  The  following  correlatiocs 
were  obtained  between  number  of  mission  requirements  completed  in  each 
of  the  three  phases  of  training  at  the  end  of  the  sixth  week:  Phase  I  v. 
Phase  II,  0.36;  Phase  I  r.  Phase  III,  0.28;  Phase  II  v.  Ill,  034, 
giving  an  average  intercorrelation  between  amount  accomplished  in  the  3 
phases  of  33.  Each  coefficient  was  the  average  by  Fisher’s  z,  of  the  sepa¬ 
rate  coefficients  obtained  with  each  of  24  CCTS  classes  at  10  different 
stations,  and  represented  data  from  more  than  1,200  crews.  The  chief  ob¬ 
jection  to  this  estimate  of  reliability  lies  in  the  way  training  usually  op¬ 
erated.  If  one  crew  concentrated  on  completing  the  activities  in  Phase  II, 
it  had  less  time  to  put  in  on  activities  in  Phase  I  and  Phase  III.  It  was 
known  that  supervisors  sometimes  encouraged  different  crews  v  -  concen¬ 
trate  on  different  aspects  of  training  so  that  the  available  equipment  ~ould 
be  better  utilized.  To  what  extent  this  operated  to  lower  the  intei 
relations  between  scores  for  the  three  phases  is  not  known. 

A  second  procedure  for  estimating  reliability  was  to  compare  the  numb** 
of  missions  completed  at  different  stages  of  training.  This  was  done  for 
four  B-17  CCTS  classes  at  two  stations.  Correlations  between  num'.er  of 
missions  completed  at  the  end  of  4  weeks  and  number  completed  at 
end  of  6  and  S  weeks  are  given  in  table  4.12. 

One  important  point  should  be  made  regarding  the  correlations  between 
amount  accompV.hed  at  the  end  of  various  amounts  of  training.  It  is  that 
the  amount  accomplished  at  the  end  of  the  lorger  period  cl  training  ref- 
resented  the  amount  accomplished  at  the  end  of  the  shorter  period  plus 
whatever  was  accomplished  in  the  time  between.  Hence  the  coefficients 
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jgtid  ia  the  tabk  are  spuriously  high,  doe  to  the  inehtslau  of  the  first  soon 
g  the  second. 

To  get  around  this  difficulty  the  missions  accomplished  fas  socceaht 
{4t>  ireek  periods  were  compared.  Thus  in  taKk  4.12  are  also  shown  the 
correlations  between  number  of  mission  requirements  completed  from  the 
foerth  to  the  sixth  week  and  the  number  completed  from  the  sixth  week  to 
t^e  eighth  week.  Taken  at  face  value,  the  data  in  table  4.12  would  indicate 
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vhat  the  accomplishment  of  missions  score  had  a  negative  reliability.  Of 
erase,  the  main  objection  here  lies  in  the  fact  thtf.  the  crews  tha.  had 
completed  most  of  their  missions  early  in  training  isually  had  only  the 
long  and  difficult  missions  remaining.  Other  crews  tha'  had  completed  less 
in  thvr  early  weeks  of  training  still  had  many  easy  iiissions  which  they 
could  -implete  in  a  relatively  short  time  later  on  in  tra  uing. 

The  bird  type  of  analysis  was  to  divide  the  training  -equipments  into 
edd  and  even  groups  and  compare  the  number  of  odd  requirements  com¬ 
pleted  wi,n  the  number  of  even  ones  completed.  The  coefficients  of  re¬ 
liability  coo  puted  in  this  way  are  shown  in  table  4.13.  The  main  objection 
to  these  figures  is  the  same  as  that  brought  against  the  use  of  a  split-half 
method  in  determining  the  reliability  of  any  speed  test.  In  a  statistical 
sense  the  numi  er  of  requirements  completed  during  a  particular  period  of 
training  is  like  «.  sc^re  on  a  speed  test 
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Bombardment  Scare* 

Although  the  main  discussion  of  bombardment  scores  is  found  in  dt^. 
ter  7,  Bombardier,  some  mention  should  be  matk  here  of  their  possible 
uk  as  criteria  of  proficiency  for  airplane  commanders.  In  operation^ 
training,  as  in  bombardier  training  in  the  AAF  Training  Command,  the 
average  circular  errors  o'  bombs  dropped  on  targets  at  bombing  ranges  wot 
treated  administratively  is  primarily  the  achievement  of  the  bombardier 
However,  training  personnel  have  usually  emphasized  that  the  shill  of  nrhn 
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crew  members,  particularly  that  of  the  airplane  commander,  have  an  im¬ 
portant  effect  upon  the  accuracy  of  bombing.  That  this  is  true  has  been 
demonstrated  rather  conclusively  in  research  on  bombing  accuracy  at  bom¬ 
bardier  schools  of  the  AAF  Training  Command,  where  it  was  found  that  the 
p3ot  was  accountable  for  nearly  as  much  variance  in  bombing  scores  as  was 
the  bombardier.  With  radar  bombing  scores  the  pari  played  by  crew  mem¬ 
bers  other  than  the  bombardier  was  even  greater,  since  a  new  crew  member, 
the  radar  observer,  carried  on  a  vital  part  of  the  bombing  operation.  Thus,  a 
brief  discussion  of  average  circular  error  and  radar  bombing  scores  is  in¬ 
cluded  in  the  discussions  of  criteria  of  proficiency  of  airplane  commanders. 

Average  Circular  Error 

Because  of  the  many  known  sources  of  error,  the  routine  records  of 
average  circular  error  for  combat  crews  in  the  Continental  Air  Forces  were 
not  well  suited  to  serve  as  proficiency  criteria.  However,  these  scores  did 
have  some  degree  of  reliability,  since  for  7  samples  totaling  nearly  600  B-17 
and  B-24  crews,  the  coefficients  of  reliability  based  od  odd-even  mission 
performance  varied  from  0.26  to  0.67.  There  was  evidence  that  circular 
error  averages  based  upon  photographs  of  the  bomb  bursts  were  more  re¬ 
liable  than  those  including  both  photographed  and  estimated  circular  errors. 
For  further  discussion  of  average  circular  error,  see  discussion  under 
Criteria,  chapter  7,  Bombardier. 

Radar  Bombing  Scores 

Radar  bombing  of  i  dustrial  targets  in  operational  training  simulated 
actual  combat  bombing  conditions  much  more  closely  than  did  the  actual 
release  of  bombs  or.  tarn's  at  bombing  ranges.  The  chief" problem  met  to 
studies  of  radar  bombing  vas  that  of  securing  adequate  scoring  of  the  bomb 
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nm  A  number  of  scoring  methods  were  used  during  the  period  when 
bodies  of  *adar  bombing  scores  were  being  made  by  aviation  psychologists 
is  the  Continental  Air  Forces.  Analysis  cf  data  obtained  with  the  use  ol 
tl*  different  methods  of  scoring  indicated  that  the  best  scoring  procedure 
from  the  point  of  view  oi  reliability  was  the  radar  scoring  under  Project 
5$4,  Radar  Bomb  Scoring.  However,  only  a  small  amount  of  data  were 
available,  as  this  method  of  sewing  was  developed  just  prior  to  the  dose 
of  hostilities.  Odd-even  mission  reliability  of  this  type  of  scoring  radar 
bombing  was  0.69.  Further  discussion  cf  radar  bombing  scores  is  gives  !e 
chapter  7,  Bombardier,  under  Criteria. 

Ground  Training  Performance 

There  was  considerable  diffeience  of  opinion  among  training  personnel 
and  officers  with  combat  experience  as  to  what  extent  performance  hi 
ground  training  was  related  to  combat  proficiency.  The  fact  that  it  has 
been  necessary  to  include  this  type  of  training  even  in  the  theaters  of  op¬ 
erations  seemed  to  research  personnel  to  justify  some  study  of  performance 
in  ground  school.  Two  types  of  records  of  performance  were  available. 
These  were  academic  grades  and  scores  on  ground  trainers. 

Academic  Grades 

Academic  grades  were  usually  given  each  airplane  commander  in  the 
various  ground  training  courses  required  in  operational  training.  The  basis 
of  grading,  the  type  of  grade  and  the  significance  attached  to  various 
grades  varied  with  the  instructor,  course,  class,  station  and  air  force.  Some¬ 
times  the  course  grade  was  merely  a  rating  by  the  instructor.  Sometimes  the 
course  grade  was  the  grade  made  on  an  achievement  type  examination 
given  at  the  end  of  the  course.  Hence  it  is  not  possible  to  make  many  use¬ 
ful  generalizations  about  the  nature  of  these  grades  or  about  their  useful¬ 
ness  as  possible  criteria  of  proficiency  of  airplane  commanders. 

An  attempt  was  made  to  estimate  the  reliability  of  ground  school  grades 
at  various  stations  in  the  Second  Air  Force.  This  was  done  by  comparing 
the  grades  and  scores  achieved  in  successive  periods  of  ground  school  train¬ 
ing.  Table  4..  4  lists  the  reliability  coefficients  obtained  in  this  way.  These 
coefficients  are  probably  spuriously  high  since  it  was  not  possible  to  deter- 


Table  a. 14.-- Coefficient:  of  reliability  of  academic  grades 
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fiaxmrtring,  fint  half  v  second  hslf  of  training . 

Boxbi.'djntnt,  first  half  v.  second  half  of  training. .. 
Commuaicaiions,  fint  half  v  see  md  ball  of  training. 

yunuery.  fint  half  v.  second  half  of  training . 

Aren*  all  courses,  fint  hall  v.  total  training’ . 


‘At  thU  Second  Air  Force  Station  seperate  grades  were  not  tecorded  for  tb*  secood  h»K  oi Jrtia- 
**-  Tbuj  the  grade  foe  total  training  Inc!-  '*d  tbc  grades  for  the  first  haU.  Henc*  thiscnrflrUmt 
***  Mt  been  corrected  by  the  Spearmar-Bro»n  formula.  Even  so  It  Is  probably  spuriously  high. 
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mine  the  extent  to  which  scores  in  the  first  part  of  training  influenced  U* 
scores  given  at  later  stages  of  training. 

In  addition  to  the  above  data,  research  personnel  in  the  16th  Wing  of  the 
Second  Air  Force  obtained  designations  of  average  ground  school  grafa 
of  crew  personnel  of  each  specialty  in  terms  of  the  two  categories  of  upper, 
half  and  lower-half  of  the  class.  No  data  on  reliability  of  these  grades  were 
obtained. 

Finally  at  March  Field  in  the  Fourth  Air  Force  date  were  obtained  oa 
two  tests  given  in  ground  school  subjects:  C-l  Autopilot  Examination  and 
Engineering  Examination.  Nc  reliabilities  were  determined  for  these  scores 

Ground  Trainer  Scores 

1.  The  L'nk  Trainer  was  the  most  important  of  the  ground  trainers 
worked  with  by  airplane  commanders,  although  in  operational  training  they 
w*re  also  given  training  oa  other  types  of  trainers.  The  Link  Trainer 
i/as  a  device  consisting  of  a  cockpit  with  instrument  panel  and  controls 
roughly  similar  to  those  found  on  a  relatively  simple  type  of  training  plane. 
The  device  was  so  constructed  that  manipulation  of  the  controls  resulted 
in  changes  in  the  attitude  and  position  of  the  cockpit  and  changes  in 
readings  of  instruments  which  corresponded  closely  to  changes  which 
would  result  from  similar  operation  of  controls  in  real  flight  The  trainer 
also  made  a  record  of  the  simulated  flight  path  of  the  pilot  including  all 
of  the  important  variables  of  flight. 

There  w^s  great  variation  between  stations  in  the  amount  of  type  of 
training  given  and  in  the  records  maintained  thereof.  Usually  for  each 
training  session  or  “mission”  a  score  was  recorded  which  represented  the 
judgment  of  the  instructor  as  to  the  skill  shown  by  the  pilot.  This  score 
was  most  often  a  three-point  rating  and  was  based  on  a  judgment  of  the 
degree  to  which  the  pilot  maintained  the  briefed  course  according  to  the 
recorded  flight  path.  The  reliability  of  Link  Trainer  scores  is  indicated  by 
the  data  presented  in  table  4.15,  where  the  average  scores  obtained  on  odd 
and  even  missions  are  compared.  For  the  data  in  the  table  the  number  of 
missions  per  pilot  varied  from  6  to  10.  In  the  case  of  the  B-17  data,  all 
cases  were  obtained  from  the  same  station  and  a  single  coefficient  of  «■ 
liability  was  computed.  With  the  B-29  data,  separate  reliability  coefficients 
were  computed  for  each  class  and  station.  The  different  coefficients  were 
then  averaged  by  Fisher’s  r  to  yield  the  coefficients  given  in  the  table. 

Similar  Link  Trainer  ratings  were  available  at  two  stations  in  the  Fourth 


Table  4.5 S. — Reliability  of  Uni  trainer  scores 
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Air  Foret.  The  odd*«vtn  mission  reliability,  based  on  ratings  of  $  missions, 
was  found  to  be  0.63  for  56  airplane  commanders.  In  addition  to  the 
ratings  a  Link  Trainer  Examination  of  30  objective-type  items  was  ad¬ 
ministered  at  the  outset  of  training  at  1  of  these  stations.  Data  on  tbit 
test  were  compared  with  average  ratings  on  the  Link  Trainer  missions,  the 
latter  being  divided  into  two  categories  of  upper  and  lower  half  of  the 
group.  The  biserial  coefficient  of  correlation  between  examination  score 
and  Link  Trainer  rating  was  0.46  for  52  airplane  commanders. 

A  rather  different  type  of  measure  of  proficiency  was  also  sometimes 
available  in  connection  with  Link  Trainer  performance.  This  was  tht  num¬ 
ber  of  Link  Trainer  hours  taken  by  a  pilot  to  complete  the  minimum  re¬ 
quirements.  Of  course,  this  measure  was  meaningless  at  those  stations  at 
which  there  were  no  minimum  proficiency  standards  and  at  stations  where 
tbe  requirements  were  solely  in  terms  of  hours  of  practice.  As  with  other  . 
similar  measures  (e.g.  Rate  of  Training  Accomplishment,  etc.)  it  was  not 
possible  to  obtain  any  estimate  of  the  reliability  of  this  score. 

2.  Miscellaneous  trainers. — Airplane  Commanders  were  also  required  in 
operational  training  to  piactice  on  various  navigation  and  bombing  trainers. 
The  amount  and  nature  of  such  training  varied  even  more  than  did  train¬ 
ing  on  the  Link  Trainer.  Frequently  the  training  represented  only  a 
familiarization  with  the  equipment  involved.  Often  no  attempt  was  made 
to  assess  the  performance  of  the  airplane  commanders.  However,  sufficient 
trainer  practice  was  required  at  one  Second  Air  Force  station  to  provide 
data  for  computation  of  reliability  of  certain  trainer  scores.  The  coefficients 
of  reliability  for  Dead  Reckoning  and  Celestial  Navigation  Traine*-  Scores 
of  airplane  commanders  were  found  to  be  0.37  and  0.18  respectively,  based 
on  the  correlation  between  average  scores  for  odd  and  even  missions.  With 
the  Celestial  Navigation  Trainer  only  two  missions  were  available  while  on 
the  Dead  Reckoning  Trainer  there  were  at  least  four  missions.  At  AAF 
Muroc  (prior  to  establishment  of  the  Lead  Crew  School)  Fourth  Air / 
Force,  circular  error  scores  were  obtained  for  a  number  of  airplane  com¬ 
manders  on  the  A-2  Synthetic  Bomb  Trainer.  No  reliabilities  were  com¬ 
puted  for  these  scores. 

Flying  Evaluation  Board  Reports 

The  principal  function  of  Flying  Evaluation  Boards  was  to  investigate 
and  appraise  aircrew  officers  who  had  refused  to  fly,  who  were  charged 
with  some  type  of  incompetence,  or  who  were  believed  not  to  meet  the 
medical  standards  required  for  flight  status.  FEB  reports  of  varying  degrees 
of  completeness  were  usually  available  in  each  of  the  Continental  Air 
Forces.  Sometimes  these  reports  included  much  pertinent  biographical 
material,  testimony  of  associates  and  supervisors  and  other  material  as  well 
as  the  action  of  the  Board.  In  other  cases  the  reports  included  only  the 
bare  statement  of  Board  action  with  a  reason  ‘.or  the  action  stated  in  a 
single  word  or  short  phrase.  The  major  difficulty  in  the  use  of  reports  of 
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Flying  Evaluation  Boards  as  criteria  of  proficiency  vu  the  lack  of  stand¬ 
ardization  in  methods  of  investigation  and  evaluation,  and  the  brevity  of 
some  of  the  reports.  Usually,  however,  the  reports  at  least  permitted  classi¬ 
fication  of  board  action  into  three  main  categories  of  reasons  for  action: 
personality  defect  (principally  fear  of  dying);  lack  of  proficiency;  and 
physical  disability.  The  percentages  of  cases  falling  into  the  various  cate- 
gories  are  given  in  an  earlier  section  of  this  chapter  under  Job  Specifica¬ 
tions. 

Since  final  board  action  was  in  each  case  a  unique  event,  it  was  not  po* 
sible  to  make  any  estimate  of  the  reliability  of  this  criterion. 


Aircraft  Accidents 


Pilots  having  aircraft  accidents  directly  attributable  to  lack  of  skill  in 
handling  the  aircraft  may  obviously  be  considered  as  showing  a  relatively 
low  degree  of  proficiency — at  least  at  the  time  of  the  accident  Hence  re¬ 
search  personnel  in  each  of  the  Continental  Air  Forces  made  some  study  of 
aircraft  accidents  and  attempted  to  use  their  occurrence  as  a  criterion  of 
lack  of  proficiency  in  validation  studies.  The  relative  frequencies  of  various 
types  and  causes  of  accidents  in  heavy  bombardment  training  are  shown 
in  tables  4.16  through  4.19.  The  data  from  the  Second  Air  Force  were 


based  on  the  records  of  the  296  bombardment  aircraft  accidents  occurring 
in  the  command  between  I  October  1944  and  1  April  1945.  The  Fourth  Air  j 
Force  data  included  165  B-24  accidents  reported  during  January  and  Feb¬ 
ruary  1945. 

The  data  in  the  tables  are  more  or  less  self-evident.  It  might  be  pointed 
out  that  while  there  were  marked  differences  between  the  Second  and 
Fourth  Air  Force  data  in  the  percents  of  different  types  of  accidents  (  table 

Tab  lx  4. '6. — Rate  of  bombardment  aircraft  accidents  per  1000  hours  flown 
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Type  at  .ircrmlt 


4.17),  the  percent  attributable  to  pOot  error  (table  4.W)  was  the  sen*  In 
both  cases.  The  differences  in  nature  of  the  accidents  (table  4.17)  t 
veil  have  been  due  to  differences  in  the  type  of  involved.  The  Ma¬ 
jority  of.  the  Second  Air  Force  accidents  were  B-29  accidents  while  those 
bn  the  Fourth  Air  Force  were  B-24  nrrt/Wff 
It  was  only  rarely  that  an  airplane  commander  had  more  than  ooe  r~*- 
dent  during  operational  training.  As  rough  evidence  here  might  be  dted  the 


Tuu  4.11. — Fcr cents  of  bombardment  aircraft  acdieatt  af  Mfertm  imam 
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Taslk  41 9. — Percents  of  different  errors  »  flight  technique 

_ M  a-14  PHOTS— FOURTH  AIR  FOaCS 

Type  of  error  In  Sying  techniqn:  f 


Twcsstsf 


Operation  of  flight  controls . 

Power-plant  procedures  . 

Supervision  of  crew  . . 

Opentior  of  auxiliary  controls _ 

Judgment  . . . . 

Radio  technique  and  copilot  procedure 

Observation  and  orientation  . 

Safety  violations  . 

Total . 


fact  that  out  of  the  161  B-24  pilots  in  the  Fourth  Air  Force  who  had. 
accidents  in  January  and  February  1945,  only  4  had  2  Such  accidents. 
Suffering  an  aircraft  accident  was  almost  a  unique  (in  a  statistical  sense) 
event  for  an  airplane  commander.  Thus  it  was  not  possible  to  determine  the 
reliability  of  the  occurrence  of  aircraft  accidents  as  a  criterion  of  profi¬ 
ciency. 


Assignment  as  Airplane  Commander  or  Copilot 

Whether  a  particular  graduate  from  Advanced  Pilot  School  was  assigned 
to  further  training  es  an  airplane  commander  or  as  a  eopuot  was  not, 
strictly  speaking  a  criterion  of  proficiency  in  operational  training.  How- 
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ewer,  the  fact  that  each  boatordnecC  err*  studied  lad  aa  akpbae  oo» 
attader  ud  a  copilot  made  operational  tracing  a  convenient  Mtct  a 
data  far  a  study  of  the  vaScfity  of  selection  procedures  in  predicting 
■nignmcaL  Tkere  were  astarafly  so  data  2a  tke  reSahSty  of  tin  my 
ncaL  Available  jafarmatioa  on  the  procedures  sometimes  used  would  lead 
one  to  the  condasion  that  the  matter  seas  frequently  derided  largely  on  ffc 
basis  of  adnrinistratlse  conweaknca. 


Tke  esplcntocy  nature  of  many  of  the  studies  of  criteria  node  by  am- 
tioo  psjxbciopsts  in  tke  Continental  Air  Forces,  and  tke  vide  differences 
vdma  stations  in  trs  niag  procedures  and  records  maintained,  made 
systematic  s^edy  of  the  rrtafiondrips  between  all  criteria  moowble.  la 
the  paragraphs  which  follow  are  presented  what  data  were  available.  Hot 
of  them  are  fragr  lentaiy  and  the  numbers  of  cases  available  for  the  Af¬ 
ferent  compaurons  are  rather  wnrR 

ConeUdien  Better »  Ratirngg 

The  intercorrelatiocis  between  various  types  of  ratios  made  on  B-17 
airplane  commanders  in  the  Second  Air  Force  are  given  in  table  420.  Tke 
Efficiency  Rating,  Focn  66-2,  Officer  Quality  Rating  and  Tedmkal  Air, 
crew  Skill  ratings  were  five-point  ratings  ranging  from  “poor”  to  “superior.* 
The  AFTRC  Form  2  ratings  were  three-point  ratings  with  the  nwAty  rat¬ 
ing  being  ‘  average.”  Rack  in  Class  was  a  rating  in  which  instructors  listed 
the  airplane  commanders  in  a  class  in  the  order  of  their  expected  proficiency 
in  combat.  The  coefficients  of  corrdathm  are  given  above  and  to  the  right 
of  the  diagonal  in  the  table,  while  the  numbers  of  cases  included  in  each 
coefficient  are  designated  below  and  to  the  left.  It  should  be  stated  in  this 
connection  that  the  same  personnel  usually  did  most  of  the  ratings  for  a 
given  set  of  crews. 


Tabu  4  JO. — Correlations  between  diferent  ratings  of  airplane  commanders1 
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Officer  quality  rating. . 

Technical  aircrew  tull  ratine . 

AFTRC  Font  2: 

Military  discipline . 

Manner  of  perioncin*  duties. ... 

General  aircrew  ability . 

Ranh  ia  daw . 
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F . 
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21 

21 

21 

4.44 

21 

21 

21 
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*  Entries  below  the  dia*ocal  an  tie  numben  of  cases  for  tie  correspond!**  ocrdstloa  coefficients. 


A  number  of  different  types  of  ratings  of  B-24  airplane  commanders  were 
also  made  in  the  Second  Air  Force  where  each  rating  was  made  independ¬ 
ently  by  a  different  observer  or  group  of  observers.  The  intercorrelations 
between  such  ratings  are  given  in  table  4.21.  The  interview  rating  was  an 
average  of  10-point  ratings  for  6  traits  made  by  a  board  of  2  training  of- 
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fcflj  and  SB  snstxn  psychologist  who  interviewed  each  of  the  ahplaat 
e^caaixieTS.  The  gnxrod  school  rating  was  the  average  ol  the  of 

£e  airplane  commanders  lor  all  academic  courses.  The  flight  svfecrt 
at**  was  a  3-poast  rating  of  which  the  middle  rating  was  “average."  The 
or*  and  sdf-ratiags  were  averages  ol  10-point  ratings  on  6  traits  by  feflow 
off  uegabets  and  by  the  airplane  commander  InwoH  Ranh  in  dut  wns 
fisting  ol  the  airplane  commanders  in  the  order  ol  their  espec'td  ef- 
lectheness  in  combat.  In  the  table,  the  corScients  cf  caraelaika  are  pwa 
n  the  right  md  above  the  diagonal  and  the  numbers  of  cue.  in 

ffA  are  designated  below  and  to  the  left. 


T «u  4-2I-— Correlations  between  £fiere*t  ra'-sp  >;  mptanz  eommmdms* 
n-24  umulsi  commanders— second  ant  rones 


The  corrriatiops  between  self-ratings  ol  interest  in  lead  crew  »wpwH 
znd  over-all  ratings  ol  lead  crew  proficiency  for  B-29  airplane  commanders 
rated  with  Scales  A  and  B  in  the  Second  Air  Force  are  shown  in  tat&  4J2. 
For  Scale  A,  the  three  statements  required  ratings  by  the  airplane  com¬ 
mander  of  his  desire  for  his  own  and  for  his  crew’s  assignment  in  lead  crew 
position  and  rating  of  his  crew’s  desire  for  such  assignment.  With  Scale  B 
only  the  latter  rating  was  obtained.  The  coefficients  in  t  he  table  show  that, 
especially  for  Scale  B,  there  was  a  slight  tendency  for  airplane  commanders 
who  reported  high  degree  of  interest  in  lead  crew  assignment  to  be  regarded 
by  instructors  as  good  prospects  for  such  assignment. 


Tuu  A 22  — Correlations  between  interest  end  over-all  rating  of  teed  crew  proficiency 
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The  Airplane  Commander  Questionnaire  in  the  Third  Air  Force  repre¬ 
sented  a  kind  of  self-rating.  Both  it  and  the  Crew  Proficiency  Check  (VHB) 
were  administered  for  175  B-29  crews  at  4  Third  Air  Force  stations. 
There  were  12  items  of  the  Crew  Proficiency  Check  for  which  there  were 
directly  parallel  or  analagcus  questions  in  the  Questionnaire.  It  was,  there¬ 
fore,  of  seme  interest  to  compare  the  scores  made  by  the  airplane  com¬ 
mander?  on  the  12  items  of  the  Questionnaire  with  the  ratings  given  them 
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on  the  wiepoudit|  items  of  the  Crew  Proficiency  Check.  The  cscnhCq 
hftff  scores  oa  the  two  sets  of  items  was  0_»6  for  ITS  wpbie  oo%. 


Cjrrdtfimt  Between  Ratings  end  BemUmg  Scare* 

Data  oo  the  crew  average  circular  error  for  pcactic*  bombing  of  taija 
oa  bomba*  ranges  were  available  for  the  crews  of  434  pilots  of  8  CCR 
(H)  who  were  naked  m  their  flights  by  their  instructors  in  terms  of  their 
effectiveness  in  combat.  The  correlation  between  rank  in  % 
mmI  crew  average  error  was  dtttnaocd  separately  for  each  class.  These 
coefficients  ranged  from  —0.17  to  0J7  and  when  averaged  by  Fisherh  i 
gave  a  coefficient  of  0.CS  for  the  total  group.  All  coefficients  wen  Ant  -ad¬ 
justed  in  sign  so  that  a  positive  coefficient  represented  axTektioa  w£ 
goodness  of  performance. 

The  correlations  between  average  drcuiar  error  and  ratings  of  B~29  air¬ 
plane  commanders  on  descriptive  ratings  scaks  A  and  Bin  the  Second  Air 
Force  are  given  in  table  4 23.  Although  instructors  reported  that  the  ii- 
plane  «-<vnm*nder  played  an  important  part  in  the  bombing  operation,  the 
data  in  table  4J3  show  that  the  bombing  accuracy  achieved  was  given  && 
•eight  in  their  ratings  of  airplane  commanders. 

<S«nn»r  correlations  with  radar  bombing  circular  error  T-scores  were 
gyaihble  for  airplane  commanders  rated  with  Scale  B  in  the  Second  Air 
Fore*  The  radar  bombing  T-scores  represent  die  combined  scots  frow 
three  types  of  radar  bombing  scoring  procedures,  each  type  being  <xwertd 

Tjuu  423.— Correlations  between  ratings  jJ  airplane  commander 
and  crew  bambini  scam 
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» Combine  by  mean*  oi  FIiSb’i  *  tocluJqm. 


jtparwtdy  to  corresponding  T-scau.  These  data  are  «t<o  fa 

able  4.23.  Here  again  there  is  no  r-dence  that  accuracy  b  bombbg  was 
prt*  any  weight  in  the  ratings  ci  ibe  airplane  conanandeta. 

Cmd*ih*J  Bchccen  RiOngs  tmd  M'ncdUatna  Crittri * 

Ground  school  grades  were «.  variable  for  B-29  airplane  mnwan^Tf  rated 
■sth  descriptive  rating  Scale  Am  the  Second  Air  Force.  These  grades  were 
pre*  b  terms  of  upper-half  or  knrer-half  designations  for  aB  airplane 
coeanarders  rated  with  Scale  A.  The  biserial  coefficient  of  corrdatian  b 
tween  ratings  and  ground  school  grades  was  0.06  for  160  airplane  cons- 
wanders.  Plainly  performance  in  ground  school  did  not  greatly  bfbenco 
the  ratings  gives  the  cirplane  commanders  by  flying  instrcr’ora 

The  correlations  between  ratings  of  B-29  airplane  commanders  on 
A  in  the  Second  Air  Force  and  various  crew  accomplishment  of  txfafag 
scores  is  given  in  table  4.24.  All  coefficients  :  oown  were  based  on  an  aver* 
age  by  Fisher’s  x  of  separate  coefficient^  for  each  class  and  siaiinm  Ap¬ 
parently  efficient  accomplishment  of  training  requirements  did 
somewhat  the  ratings  of  airplane  commanders. 


Tame  4.24. — Comhticms  bet-xeea  descriptive  ratings  ami 
crew  accompiishxseni  of  tfdmmg 
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In  table  4.25  are  given  the  intercorrelations  between  various  ratings  and 
test  and  trainer  scores  for  B-24  airplane  commanders  in  the  Fourth  Air 
Force.  The  over-all  ratings  were  on  the  usual  five-point  military  scale,  and 
the  Link  Trainer  Ratings  were  on  a  three-point  scale.  Examination  Scores 
were  on  the  usual  academic  scale  of  100  points.  Units  used  In  A-2  Circular 
Error  scores  are  not  known.  The  highest  intercorrelations  were  found  be¬ 
tween  C-l  Autopilot  and  Engineering  Examinations,  between  link  Trainer 
Rating  and  Link  Trainer  Examination,  and  between  Over-all  Rating  and 
Engineering  Examination. 

The  correlation  between  ratings  c  n  Descriptive  Rating  Scale  B  and  hours 
taken  to  complete  Link  Trainer  req-hrements  was  0.29  for  41  airplane  cotn- 


Tasle  4.25. — IniucorrcJaiions  amon[  criteria  of  proficiency 
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wanders  at  one  Secood  Air  Force  Station.  At  another  station  appcoxmutdy 
half  of  the  airplane  commanders  failed  to  meet  the  special  Link  Trainer  re¬ 
quirements  set  up  there.  The  biserial  coefficient  of  correlation  between 
ratings  on  Scale  B  and  completion  of  Link  Trainer  requirements  was  OJt 
for  the  46  airplane  commanders  involved  in  the  study. 

Evaluation  of  Criteria 

Is  the  evaluation  of  the  various  types  of  proficiency  criteria,  it  b  tod* 
to  consider  each  of  than  is  terms  of  certain  features  desirable  is  a  criterion. 
In  order  to  be  as  brief  as  possible,  the  total  group  of  criteria  of  airphae 
commander  proficiency  described  in  the  preceding  sections  will  be  dbcasstd 
below  under  each  of  five  main  desirable  features* 

Nature  and  Distribution  of  Scores 

Many  of  the  criteria  of  airplane  commander  proficiency  meet  this*  m 
quirement  in  a  satisfactory  manner.  However,  certain  of  them  do  not  For 
example,  the  routine  efficiency  ratings,  the  upper  and  lower  half  ratings  of 
proficiency  in  the  Fourth  Air  Force  arid  all  of  the  threepoint  ratings  includ¬ 
ing  link  Trainer  ratings  provide  too  little  discrimination  between  individ¬ 
uals  to  be  of  mavimum  value.  For  a  somewhat  different  reason  the 
elimination  of  airplane  commanders  by  Flying  Evaluation  Board  A'.tica 
and  the  occurrence  of  Aircraft  Accidents  Due  to  FOot  Error  are  also  un¬ 
satisfactory.  Here  the  chief  difficulty  is  the  small  percentage  of  airplane 
commanders  that  is  involved.  Finally,  the  self-ratings  of  Interest  in  Lead 
Crew  Assignment  of  Scale  A  in  the  Second  Air  Force  produced  distributions 
of  scores  that  were  too  skewed  for  practical  use  as  criteria. 

Reliability  or  Consistency 

Under  this  requirement,  the  chief  problem  has  been  to  obtain  evidence 
upon  which  to  base  a  judgment  For  none  of  the  following  types  of  ratings 
was  there  any  data  on  reliability  obtained:  3-j.oint  Over  all  Ratings  in  the 
Second  Air  Force;  Interview  Board,  Mutual,  and  Self-Ratings  of  B-24 
airplam  commanders  in  the  Second  Air  Force;  and  all  Check  List  Ratings 
in  the  Third  Air  Force.  However,  if  the  criteria  had  been  considered  satis¬ 
factory  in  other  ways,  most  of  these  reliabilities  could  have  been  determined 
<airly  easily.  In  the  case  of  the  Third  Air  Force  Check  List  Ratings  the 
closing  down  of  crew  training  prevented  the  securing  of  the  desired  data. 

In  contrast,  Rate  of  Training  Accomplishment,  Hours  to  Complete  Link 
Trainer  Requirements,  Flying  Evaluation  Board  Action  and  Aircraft  Acci¬ 
dents  were  not  susceptible  to  analysis  iu  terms  of  reliability  under  condi¬ 
tions  of  operational  training.  Of  moderate  and  fair  degree  of  reliability 
were  the  Descriptive  Ratings  of  Lead  Crew  Proficiency  it.  the  Second  Air 
Force,  the  Mission  Ratings  in  the  Fourth  Air  Force  and  Radar  Bombing 
Scores.  Average  Circular  Error  for  Practice  Bombs,  Academic  Grades 
and  certain  Ground  Trainer  Scores  bad  some  reliability  but  not  as  much 
as  would  be  de  irable  in  an  acceptable  criterion  score. 
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Piunrntnatum  Between  Airplane  Commanders  oj  Known  Proficiency 

No  evidence  urder  this  heading  *  is  obtained  for  criteria  of  airplane  coa» 
wander  profiriercy  in  the  Continental  Air  Forces.  Because  cf  their  nature, 
even  if  ratingr.  did  discriminate  between  irdividuals  known  to  differ  in 
proficiency,  this  fact  would  be  no  point  in  their  favor.  The  degree  of  profi¬ 
ciency  of  the  groups  concerned  would  have  to  be  unknown  to  those 
the  ratings—*  situation  that  would  be  practically  impossible  b  operations! 
training. 

Breadth  oj  Activities  Covered 

Superficially  at  least  the  Over-al*  Judgment  Ratings  and  the  Flying 
Evaluation  Board  Actions  would  seem  outstanding  in  terms  of  this  feature 
ci  criteria.  However,  a  little  further  thought  would  lead  to  some  question 
here.  The  extent  to  which  the  individual  rater  really  canvassed  all  aspects 
of  performance  of  the  airplane  commanders  being  rated  is  open  to  doubt. 
Derision  by  a  board  of  several  individuals  might  be  expected  to  be  some- 
what  better  in  this  respect  In  any  case  how  the  rough  a  consideration  was 
given  all  aspects  of  the  job  in  any  set  of  •  t tings  was  not  known.  All  ratings 
involving  ratings  of  several  specified  traits  including  the  Check  List  type 
of  ratings  probably  covered  fairiy  well  those  aspects  of  airplane  commander 
proficiency  actually  specified  in  the  instrument  concerned.  The  extent  to 
which  they  represent  complete  coverage  depends  upon  how  well  the  par¬ 
ticular  set  of  traits  or  characteristics  covers  the  job  of  airplane  commander. 
In  the  case  of  criteria  reported  in  this  chapter,  the  sets  of  traits  and  charac¬ 
teristics  covered  by  the  various  instruments  and  rating  devices  were  those 
provided  by  groups  of  experts  and  may  be  presumed  to  represent  fair  cover¬ 
age  of  the  important  aspects  of  the  job. 

The  accomplishment  of  training  criteria  are  open  to  the  objection  that 
speed  in  getting  things  done  is  not  the  sole  aspect  of  performance  that  is 
important  Ground  Training  Criteria,  Aircraft  Accidents  and  Bombing 
Scores  represent  only  part  of  the  imporvnt  aspects  of  the  job  of  airplane 
commander. 

Objectivity 

Objectivity  is  the  main  feature  of  prof  ciency  criteria  wherein  ratings  of 
most  types  fail  miserably  in  meeting  the  need  in  research  on  selection  and 
training.  In  this  respect,  over-all  numerical  ratings  are  probably  the  worst 
With  descriptive  ratings  the  attention  of  the  rater  is  at  least  directed  to¬ 
ward  different  aspects  of  the  proficiency  of  individuals  being  rated.  It  is 
interesting  that  where  reliability  is  thought  of  as  agreement  between  ratings 
of  different  observers,  such  agreement  may  also  be  obtained  by  similiarity 
of  bias  or  prejudice.  Logically  best  among  the  various  types  of  ratings  are 
those  that  call  for  evaluation  of  observed  behavior  of  the  person  being 
rated.  Mission  Ratings  are  thus  probably  superior  to  general  Descriptive 
Ratings.  And  best  of  all  in  this  respect  are  tb?  Check  List  Type  ratings 
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swell  as  those  developed  in  the  Third  Air  Force.  It  b  probable  that 
Academic  Grades  (except  those  based  largely  upon  examination  scores) 
and  Flying  Evaluation  Board  Action  are  also  open  to  a  considerable  degree 
of  subjectivity.  The  remaining  criteria  studied  would  seem  to  have  satiy 
factocy  objectivity. 

Susceptibility  to  Miscellaneous  Sources  oj  Error 

There  could  be  almost  endless  discussion  of  all  of  the  possible  sources  of 
error  for  the  vari  ous  criteria  of  airplane  commas-.?  proficiency  studied. 
Probably  the  most  important  point  to  be  made  here  is  one  that  has  been 
repeated  throughout  the  discussions  of  the  various  criteria.  This  is  that 
training  procedures  and  records  kept  varied  with  the  instructor,  flight,  da», 
station,  and  air  force.  Attempts  to  specify  rigidly  the  conditions  of  training 
met  with  failure  for  all  sorts  of  reasons.  Difference  in  experience  on  the 
part  of  instructors,  changes  in  equipment,  weather,  personnel  shortages, 
changes  in  commitments,  differences  in  experience  on  the  part  of  trainees, 
changing  requirements  in  combat,  etc.,  arc  but  a  few  of  the  sources  of 
variation.  Where  a  criterion  involved  routine  ..cords,  such  factors  as  care¬ 
lessness,  desire  to  mzke  a  good  s!*owing  and  the  lBu  were  important  sources 
of  error.  Sheer  pressure  of  tune  and  overworking  of  training  personnel 
played  their  par.*.  Unfortunately  the  more  objective  types  of  criteria  wet* 
probably  as  much  affected  by  these  miscellaneous  sources  of  error  es  were 
ratings  and  o*her  subjective  criteria. 

Recapitulation 

In  summary,  it  is  believed  that  Mission  Ratings  and  Check  List  Ratings 
are  the  most  likely  of  the  rating  procedures  to  be  useful  in  validation  and 
other  research.  Unfortunately  data  on  the  reliability  of  the  Check  list 
Ratings  were  not  obtained  and  only  an  hypothetical  judgment  can  be  mafo 
in  this  case.  Ground  Trainer  Scores,  Rate  of  Training  Accomplishment, 
Aircraft  Accidents,  and  Flying  Evaluation  Board  Action  would  seem  ihe 
best  of  the  remaining  criteria,  all  things  considered.  Bombing  scores  might 
be  included  except  that  they  are  probably  determined  to  an  equal  or 
greater  extent  by  the  proficiency  of  other  crew  members.  Finally,  because 
of  the  low  degree  of  intercorrelation  between  the  ratings  on  different  traits, 
the  Interview  Board  Ratings  would  be  interesting  to  study  further. 

VALIDATION 

Stanine  Validity 

Ratings  of  Oc0r-all  Proficiency 

In  table  4.26  are  shown  the  correlations  between  the  augmented  pilot 
stanine  of  B~1 7  and  B-24  airplane  commanders  in  the  Second  Air  Force 
and  various  types  of  ratinyj  of  over-all  proficiency.  The  efficiency  rating, 
Form  66-2,  rating  of  attitide  toward  work  and  ratings  of  technical  a;--crew 
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,*31  arid  officer  quality  were  all  five-point  numerical  ratings.  The  general 
ability  rating  on  AFTRC  Form  2  and  the  flight  surgeon's  ratings  were 
jvjte  point  ratings.  Rankings  by  instructors  were  listing*,  of  airplane  coo*' 
ganders  in  their  flights  in  the  order  of  their  expected  effectiveness  in  coo* 
»&L  None  of  the  coefficients  differs  significantly  from  zero,  although  afl 
bd  two  are  positive.  Considerable  additional  data  were  obtained  on  the 
vajjdity  of  the  pilot  stanine  in  predicting  rankings  by  instructors  of  airplane 
ggnmandeis  in  their  flights  and  classes.  For  13  CCTS  classes  with  a  total 
of  670  airplane  commanders  (including  data  shown  in  table  4.26)  the  cor* 
relations  between  rankings  and  augmented  pffot  stanine  when  averaged  by 
fisher’s  *  gave  a  coefficient  of  0.03. 


Tabu  4.26 . — C  err  dot  ions  bet  ween  aptitude  scores  and  over-all  rating^ 
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Descriptive  Ratings'  ' 

The  correlations  between  the  stanines  of  B-24  airplane  commanders  and 
upper-half  and  lower-half  ratings  of  airplane  commander  proficiency  by  in¬ 
structors  in  the  Fourth  Air  Force  are  shown  in  table  4.27.  Since  this  was 
a  dichotomous  criterion,  all  coefficients  are  in  biserial  form.  All  three 
stanines  showed  a  statistically  significant  correlation  with  the  ratings,  that 
for  the  bombardier  stanine  being  significant  at  the  one  percent  level. 


Tabu  4.27. — Validities  of  stanines  of  airplane  commanders  in  predicting 
ratings  by  instructors 
B-24  TRAINING— FOURTH  AIR  FORCE 
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I  —  Airplane  commanders  rated  in  lover  half. 


The  correlations  between  augmented  pilot  stanines  of  B-24  airplane 
commanders  and  Interview  Board  and  Mutual  ratings  on  10-point  scales  on 
6  traits  are  shown  in  table  4.28.  The  correlation  between  stanines  and 
Interview  Board  Ratings  was  significant  at  the  five  percent  level.  In  the 
case  of  the  Mutual  Ratings  the  relationship  was  negative  and  not  signifi¬ 
cant 

The  degree  to  which  the  various  stanines  predicted  descriptive  ratings 
of  lead  crew  proficiency  of  B-29  airplane  commanders  in  the  Second  Air 
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Force  is  shows  is  table  4.29.  The  table  includes  data  from  both  Scale  A 
and  Scale  B.  The  rating  score  used  was  the  average  rating  per  Item  for  tie 
combined  ratings  of  two  raters  on  all  items  of  each  scale.  These  data  wen 
based  os  two  sets  of  ratings  because  it  was  believed  that  some  of  the  entcj 

Taste  4.28. — Correlations  between  augmented  pilot  aa-Jnes  and  si tm  0/  trait  rating, 
%-U  AIRPLANE  COMMAND EkS— SECOND  AIR  FORCE 
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of  subjective  bias  might  be  minimized  by  this  means.  It  w31  be  noted  that 
while  Scale  A  was  administered  for  160  airplane  commanders  and  Scale  B 
for  nearly  200  airplane  commanders,  only  73  and  86,  respectively,  were 
found  to  have  been  given  the  Aircrew  Classification  Tests.  Thus  the  air¬ 
plane  commanders  for  whom  data  are  shown  here  may  represent  a  selected 
group,  the  selection  of  which  may  have  involved  some  type  of  bias.  One 
of  the  most  interesting  features  01  the  results  is  the  tendency  for  the 
bombardier  stanine  to  predict  the  ratings  better  than  the  pilot  staniny 
Tins  is  in  agreement  with  the  data  from  the  Fourth  Air  Force. 


Tabu  4.29. — Correlations  between  stanines  0}  airplane  commanders 
and  descriptive  ratings 

SCALES  A  AND  B — B-29  CREWS— SECOND  AIR  FORCE 
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In  connection  with  the  above  data  the  question  arises  whether  the  relative 
validity  of  the  pi.ot  stanine  in  prediction  of  the  ratings  of  a  single  rater 
is  really  less  thar  its  validity  in  predict'on  of  the  combined  ratings  of  two 
observers.  The  data  on  this  point  were  inconclusive. 


Mission  Raimi: 

It  was  not  possible  to  determine  the  validities  of  the  various  stanines  of 
R-29  airplan,-  commanders  in  predicting  average  mission  grades  at  Lead 
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Crtw  School  at  AAF  Muroc  in  the  Fourth  Air  Force  since  few  of  them  had 
boa  given  the  Aircrew  Classification  Tests  fa  the  AAF  Training  Command, 

CiaJt  List  R*ti*t* 

Ko  data  were  obtained  on  the  degree  to  which  stanlnes  of  airplane  com* 
Banders  were  related  to  scores  on  the  Crew  Proficiency  check  (VHB)  and 
on  the  Scale  for  Instrument  Flying  developed  in  the  Third  Air  Force. 

Sdl-Rathfi 

The  correlation  between  the  pilot  stanine  of  54  B— 24  airplane  coon* 
manders  and  their  self-ratings  on  a  10-point  scale  on  a  total  of  6  traits 
us  found  to  be  — 0.16.  This  negative  coefficient  was  not  statistically 

significant. 

The  Airplane  Commander  Questionnaire  developed  in  the  Third  Air 
Force  was  administered  to  175  R-29  airplane  commanders  at  4  stations. 
For  the  78  airplane  commanders  for  whom  data  were  available  the  correla¬ 
tions  between  p3ot  stanine  and  score  on  the  Questionnaire  are  shown  In 
table  4  JO.  The  interpretation  to  be  placed  upon  the  negative  relationship 
found  is  not  clear.  A  possible  explanation  would  be  that  the  poorer  air¬ 
plane  commanders  gave  themselves  the  benefit  of  any  doubt  and  claims 
acceptable  alternatives  in  the  test  more  often  than  did  the  better  airplane 
commanders.  At  the  moment  sufficient  data  are  not  available  to  determine 
what  factors  were  involved.  . 


Tazle  430.— -Correlations  between  pilot  stanine  and  score  on 
airplane  commander  questionnaire 
B-29  TRAINING— THIRD  AIR  FORCE 
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Accomplishment  of  Training 

The  relation  between  the  augmented  pilot  stanine  of  airplane  corn- 
wanders  and  the  number  of  training  requirements  completed  at  the  end  of 
6  weeks  is  illustrated  in  tables  4.31  and  4.32.  In  table  4.32  are  shown  the 
separate  coefficients  representing  the  correlation  between  augmented  pilot 
stanines  of  B-17  and  B-24  airplane  commanders  of  24  CCTS  classes  at  10 
stations  in  the  Second  Air  Force  and  the  total  number  of  all  types  of 
training  requirements  completed  at  the  end  of  sixth  week  of  training.  In 
table  4.32  are  given  the  correlations  between  stanines  of  the  same  airplane 
commanders  and  mission  requirements  completed  in  each  training  phase  and 
tbe  AAF  Training  Standards  met.  Also  given  in  table  4.32  are  similar  data 
for  B-29  airplane  commanders  at  four  stations. 
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Tuu  4 12 .—Cerrdetwns  between  sUmes  */  esrfUne  commsnders 
end  UwimUi  eccemfSsbmemt 


The  data  show  that  for  B-17  and  B-24  training  the  pilot  stanine  of  tie 
airplane  commander  did  predict  to  some  extent  the  relative  number  of 
training  requirements  that  would  be  completed  by  his  crew,  at  least  in 
^mparisnn  v/ith  other  crews  in  Vs  class.  The  validity  coefficient  for  the 
whole  grouv  of  974  airplane  commanders  was  obtained  by  averaging  by 
Fisher’s  s  ill  coefficients .  for  the  separate  classes.  This  procedure  is  par¬ 
ticularly  important  in  dealing  with  Jata  of  the  sort  indicated  in  table  4J1- 
The  avenge  number  of  training  requirements  completed  varied  consider¬ 
ably  fro'i  class  to  class.  Had  this  variance  been  included  in  the  determina¬ 
tion  of  the  predictive  value  of  the  stanine,  it  is  doubtful  if  the  resulting 
coefficient  would  have  differed  signify  an tly  from  zero. 
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^  data  obtained  with  B-29  airplane  commanders  do  not  support  tha 
tndiag  with  B-17  and  B-24  training.  However,  it  is  of  considerable  ha* 
.  ^j,d  titat  the  pilot  stanine  had  a  negative  relationship  with  number 
,  Q0tn  .  The  implication  of  this  result  is  that  there  would  be  ft 
'live  relationship  between  the  pilot  stanine  and  number  of  requirements 
Llnleted  per  hour  flown.  Unfortunately,  similar  data  were  not  obtained 
JSu*B-17  and  B-24  crew*. 


frmbcrdMcat  Sc#ts 

Although  instructors  acre  of  the  opinion  that  the  proficiency  of  the  alr- 
pkne  commander  was  reflected  in  part  in  the  bombing  scores  attained  by 
there  was  no  evidence  that  the. stanines  of  airplane  commanders 
ryedicted  such  scores.  The  relevant  data  are  presented  in  table  4.33  For 
ibe  bisenal  coefficients  in  the  latter  half  of  t be  table,  the  137  B-24  air¬ 
plane  commanders  involved  were  divided  into  2  groups  on  the  baas  of  the 
size  of  the  average  circular  errors  of  the  crews.  Biserial  coefficients  of 
nudity  were  then  computed.  For  the  B-29  data,  the  snail  number  of 
cases  makes  the  negative  coefficient  obtained  with  radar  bombing  T-scors 
of  doubtful  significance. 


T»-tt  4,33. — Correlations  between  stanines  of  airplane  commanders 
and  crew  bombing  scores 
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* tr for  mane  e  in  Ground  Training 

Table  4.34  presents  coefficients  of  correlation  between  the  augmented 
jfiot  stanines  of  B-17  and  B-24  airplane  commanders  and  various  measures 
>f  performance  in  ground  training.  The  coefficients  were  in  gener  P0^ 
and  several  were  significantly  different  from  zero.  In  tion  to  e 
in  the  table,  ground  school  grade  designations  into  upper  and  lower  half 
of  class  we-e  obtained  for  160  B-29  airplane  commanders  in  the  16&  Wl?S 
in  the  Second  Air  Force.  Stanines  were  available  for  73  of  these.  The- 
serial  coefficient  of  correlaUon  between  pilot  stanine  and  ground  school 
pades  was  0.14  for  this  group.  ’■> 
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Pybtg  Evaluation  Board  Reports 

A  study  was  made  in  the  Second  Air  Force  of  the  pilots  removed  iron 
flying  status  by  action  of  the  Central  Flying  Evaluation  Board  during  a  i 
2-year  period.  According  to  the  available  records,  257  pilots  were  so  din*, 
nated  from  operational  training  during  this  period,  over  100  of  these  beug 
eliminated  in  the  last  6  months  of  the  period.  Separate  figures  were  not 
available  for  fighter  and  bomber  pilots  since  in  many  of  the  early  cases  suck 
information  was  not  recorded.  Thus  the  data  about  to  be  reported  refer 
to  both  bomber  and  fighter  pilots. 

Stanines  were  obtained  for  203  of  the  257  pQots  removed  from  flying 
status  by  Board  action.  Since  a  total  trainee  population  was  not  available 


Table  434. — Correlations  between  stanines  of  airplane  commanders 
and  ground  training  criteria 

B-17  AND  B-24  AIRPLANE  COMMANDERS— SECOND  AIR  FORCE 


from  which  to  obtain  the  necessary  statistics,  an  attempt  was  made  to  con¬ 
struct  a  control  group  for  validation  of  the  stanine  against  the  criterion  of 
elimination  from  operational  training  by  Board  action.  The  control  group 
was  obtained  by  locating  each  eliminated  pilot  in  the  Second  Air  Force 
Command  rosters,  and  then  taking  down  the  names  of  the  nearest  four 
pilots  in  the  roster  who  had  the  same  duty  specialty  listing.  For  eliminated 
pilots  without  duty  specialty  listing,  the  nearest  four  pilots  were  chosen 
without  regard  fo\  duty  specialty.  Toe  four  pilots  chosen  in  each  case 
were  then  looked  v/>  in  the  AAF  Train' jg  Command  rosters  of  stanines  of 
pilots  graduated  frt  n  advanced  pilot,  scb.ols.  In  some  cases,  stanines  were 
not  available  for  ai  /  of  the  four  names.  1  Vhere  stanines  were  available  for 
moie  than  one  of  tl  e  four,  the  one  chosen  was  the  pilot  whose  date  of  test¬ 
ing  was  closest  to  tl .  t  of  the  eliminated  pil  .  t.  For  pilots  tested  prior  to  the 
introduction  of  man -sensing  procedures,  i\  was  also  necessary  to  control 
the  Research  Unit  a  which  the  testing  occurred.  Controls  were  obtained 
in  this  manner  for  1:1  of  the  eliminated  pQus.. 
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Ic  table  4-35  below  are  given  the  average  stanines  for  the  pilots  rw* 
>ed  from  flying  status  by  Flying  Evaluation  Board  Action,  and  for  the 
trol  pQots  in  training  at  the-  time  of  such  elimination.  A  small  and  not 
Cf°ificant -difference  was  found  between  the  stanines  of  the  two  grovftt. 

B ecause  of  some  serious  sources  of  error  in  the  data,  it  was  difficult  to 
evaluate  the  results.  Some  sources  of  error  tended  to  minimize  any  dif¬ 
ferences  between  the  two  groups,  others  tended  to  increase  such  apparent 
differences.  For  example,  the  average  stanines  of  pilots  entering  operational 
fining  probably  increased  over  the  2-year  periol  of  the  study.  This  b  cor- 
loborated  by  the  fact  that  the  average  stanine  of  the  control  pilots  in  table 
4J6  is  slightly  higher  than  that  of  the  control  pilots  in  table  4J5.  The 


Ta*i*  4J S.— Comparison  of  stanines  of  pilots  removed  from  tying  by  board 
action  and  those  of  control  troupe 
SECOND  AND  TH'RD  AIR  FORCES 
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cases  tfvee  dwve  it. 

pflots  in  4.36  were  in  general  these  most  recently  in  training  sin^  the 
eliminated  pilots  with  which  they  were  paired  were  those  that  had  relatively 
more  detailed  and  complete  records  of  Board  action.  Thus  if  *** 

moved  from  flying  status  by  Flying  Evaluation  Board  action  had  been 
held  in  the  air  force  for  12  or  18  months  awaiting  Board  acrion-ash*- 
quently  happened — controls  chosen  on  the  basis  of  time  of  on 

might  have  belonged  to  a  population  with  a  different  average  stanine. 

On  the  other  hand,  it  was  conceivable  that  controls  tested  at  the  same 
time  and  remaining  in  the  air  force  in  operational  training  until  the  same 
time,  while  most  of  their  classmates  had  long  since  been  sent  overseas, 
so  because  they  also  were  doing  poorly  in  such  training  an  were 
to  repeat  the  training  in  later  classes.  From  interviews  with  training  per¬ 
sonnel,  it  was  gathered  that  for  a  long  time  officers  who  tM  in  op¬ 
tional  training  were  either  transferred  to  other  duties  without  ying 
Evaluation  Board  action  or  else  were  reassigned  to  a  later  class  for  further 
training.  This  was  contrary  to  most  recent  practice,  but  it  may  ^vetended 
to  minimize  differences  between  eliminees  and  controls  chosen  in  the  y 

they  were  chosen.  _  ,  „  , 

The  reasons  for  removal  from  flying  status  by  Flymg  v 
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action  be  divided  roughly  Into  three  classes:  medical,  unsatisfactory 
performance  and  LIF  (lack  of  intestinal  fortitude)  or  fear.  In  table  4.3* 
below  are  given  the  average  stanines  of  pilots  eliminated  for  these  three 
classes  of  reasons,  together  with  the  averages  for  the  corresponding  con¬ 
trol  groups.  Such  data  were  available  for  only  101  of  the  184  pilots  i*. 
moved  by  Board  action. 


T ami*  4 M.— Comparison  of  filet  sUudnei  of  fihli  removed  from  fiyl*t  by 
board  action  and  those  of  a  control  group 
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A  somewhat  similar  project  was  carried  out  in  the  Third  Air  Force 
where  a  total  of  101  aircrew  officers  were  removed  from  operational  train¬ 
ing  for  reasons  other  than  medical  during  1944.  In  this  group  were  65 
pilots,  17  bombardiers  and  16  navigators.  It  represented  approximately 
0.4  percent  of  the  total  number  of  such  officers  trained  in  the  Third  Air 
Force  in  1944.  Of  the  68  pilots  removed  from  training  approximately  haK 
were  airplane  commanders  and  the  other  half  were  fighter  pilots.  Because 
of  the  small  numbers  involved  no  attempt  was  made  to  separate  the  pilots 
according  to  type. 

The  stanines  of  the  pilots  for  whom  they  were  available  were  compared 
with  stanines  of  an  equal  number  of  pilots  chosen  as  controls.  An  attempt 
was  made  to  match  each  airplane  commander  removed  from  flying  status 
with  an  officer  not  so  removed  who  had  been  in  training  in  the  same  CCTS 
class  and  who  had  been  tested  at  the  same  Psychological  Research  Unit 
and  who  was  in  the  same  AAF  Training  Command  class. 1  It  was  not  pos¬ 
sible  to  match  the  groups  in  terms  of  such  a  complete  set  of  factors.  There¬ 
fore,  the  control  cases  were  matched  solely  in  terms  of  Psychological  Re¬ 
search  Unit  at  which  they  were  tested  and  AAF  Training  Command  class. 
The  means  and  standard  deviations  of  the  stanines  of  both  groups  are  com¬ 
pared  in  table  4.33  above.  All  comparisons  reveal  that  the  pilots  removed 
had  lower  stanines  than  those  of  the  control  group. 

Aircraft  Accident} 

Studies  were  rrade  in  all  of  the  Continental  Air  Forces  of  the  validity  of 
stanines  of  pilot'  in  predicting  occurrence  of  aircraft  acc  dents  in  oper* 
tional  training.  Oata  for  aircraft  accidiuts  of  fighter  pilots  have  already 
been  reported  in  Chapter  II,  Fighter  Pilti.  Data  on  the  aircraft  accidents 
of  bombardme  u  pilots  have  been  presen  ed  in  an  earlief  sect? on  of  this 


chapter  under  Criteria.  The  relation  between  the  stanines  of  the  tiiplm 
commanders  concerned  and  the  occurrence  of  aircraft  accidents  wiU  be  <Hs- 
cussed  in  the  paragraphs  which  follow. 

The  four-engine  aircraft  accidents  occurring  in  a  6-ronth  period  In 
the  Second  Air  Force  were  analyzed  by  research  personnel  in  that  com¬ 
mand.  During  the  period  concerned  396  accidents  were  reported  foe  four- 
engine  aircraft  Stanines  were  obtained  for  174  of  the  airplane 
involved  in  these  accidents.  While  this  group  included  62  patent  of  the 
B— 17  and  B-24  pilots,  only  eight  percent  of  the  B-29  pilots  involved  In 
these  accidents  were  included.  The  results  of  the  study  were,  therefore, 
not  representative  of  B-29  accidents. 

Since  neither  a  total  training  population  nor  the  statistical  characteristics 
of  such  a  population  were  immediately  available  for  use  in  comparing 
stanines  of  various  special  groups,  it  was  necessary  to  construct  a  pilot 
population  to  serve  as  a  control  for  comparing  their  stanines  with 
of  the  accident  pOots.  The  first  attempt  to  ob'nin  a  control  group  involved 
locating  the  accident  pilots  on  the  AAF  Training  Command  rosters  of  pilots 
graduating  from  Advanced  Pilot  School.  A  control  group  was  then  obtained 
by  selecting  the  name  of  the  pilot  in  the  roster  immediately  following  that  ! 
of  the  accident  pilot.  Where  that  pilot  also  had  an  accident,  the  of 
the  immediately  preceding  pilot  was  substituted.  This  control  group  was 
designated  Control  Group  A. 

A  second  control  group  was  obtained  in  a  somewhat  different  manner. 
Here  the  pilot  having  an  aircraft  accident  was  located  on  the  Command 
Rosters  of  the  Second  Air  Force.  The  names  of  the  two  preceding  and  the 
two  following  pilots  with  the  same  duty  status  and  assignment  --'ere  copied 
down.  These  names  were  then  looked  up  in  the  Rosters  of  Stanines.  If 
stanines  were  available  for  more  than  one  of  these  pQots,  the  one  chosen 
was  the  pilot  whose  testing  number  was  closest  to  that  of  the  pilot  having 
the  accident.  This  control  group  was  designated  Control  Group  B. 

In  table  4.37  are  shown  the  stanine  means  and  standard  deviations  of  the 
pilots  having  accidents  due  to  different  causes  together  with  similar  data 
for  Control  Groups  A  and  B.  , 

In  the  Third  Air  Force  studies  of  aircraft  accidents,  research  personnel 
niade  separate  analyses  of  stanine  validity  in  predicting  accidents  in 
medium  and  in  heavy  bombardment  aircraft  As  in  the  Second  Air  Force 
a  control  group  of  pilots  was  chosen  to  make  comparisons  of  stanines.  First, 
the  controls  were  so  chosen  that  they  were  pilots  in  training  in  the  Third 
Aii  force  at  the  time  of  the  accident  Then,  further,  the  controls  were 
pilots  that  had  been  examined  in  the  same  Psychological  Research  Unit 
and  had  been  given  the  same  battery  of  classification  tests  as  the  pilots 
’nth  accidents.  The  average  stanines  of  the  Third  Air  Force  pilots  suffer- 
lng  aircraft  accidents  and  those  of  the  controls  are  also  given  in  table  4.37 
above,  together  w’th  the  corresponding  standard  deviations.  Separate 
averages  are  given  for  the  pilots  h-.ving  the  40  medium  bombardment  air- 
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craft  accident!  and  for  those  having  the  122  heavy  bombardment  aircraft 
accidents. 

A  similar  study  was  made  in  the  Fourth  Ai  *  Force.  It  included  all  B—it 
aircraft  accident:  occurring  between  1  January  1944  and  i  March  194$. 
On  the  basis  of  the  reports  of  Aircraft  Accident  Investigation  Boards  tie 
accidents  were  separated  into  those  reported  as  caused  primarily  by 
error  those  of  unknown  cause  or  causes  beyond  the  control  of  the  pilot. 
Out  of  a  total  of  161  airplane  commanders  involved  in  one  or  more  a*. 

Tjuix  ill.— Comparison  of  stanines  of  airplane  commanders  kavini  aircraft  acddaos 
with  those  of  control  troups  without  accidents 
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craft  accidents;  148  wt  e  found  to  have  been  given  the  Aircrew  Classifica¬ 
tion  Tests  so  that  stai.nes  were  available  for  this  number. 

A  control  group  of  approximately  350  airplane  commanders  who 
had  no  aircraft  accident*,  as  far  as  was  fJiown  were  selected  from  the  popu¬ 
lation  of  combat  crews  rained  during  he  period  of  the  study.  The  num¬ 
bers  selected  from  crevi  in  training  i.i  each  quarter  of  the  year  were 
proportional  to  the  numhr  of  accidents  ior  the  quarter.  Of  the  3S0  contrd 
airplane  commanders  sel  ~ted,  stanines  vere  found  for  302.  The  avera? 
pilot  stanines  of  pilots  laving  accidents  due  io  pilot  error  and  to  other 
causes  and  of  the  contro’  pilots  are  shown  in  table  4,37  already  presented- 
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The  studies  in  all  three  air  forces  In  table  AM  show  that  in  general  the 
fliaiDts  of  control  groups  of  pilots  were  higher  than  those  of  airplane 
commanders  having  aircraft  accidents.  Although  the  differences  are  in  the 
ftpecied  direction,  with  one  exception  they  are  not  individually  sufficiently 
large  to  negate  the  hypotheses  they  are  chance  fluctuations.  However, 
collectively  they  indicate  a  small  positive  correlation. 

Selection  as  Airplane  Commander  or  Copilot 

The  average  pilot  stanines  of  airplane  commanders  and  copilots  in  the 
Second  and  Fourth  Air  Forces  are  shown  in  table  4.38.  There  is  obviously  a 
jr  itd  difference  between  the  stanines  of  airplane  commanders  and  those 
of  copilots.  In  the  first  comparison  in  the  Second  Air  Force  data,  where 
the  difference  was  not  so  marked,  it  is  interesting  to  report  that  at  the 
stations  at  which  these  pilots  were  assigned  in  the  Second  Air  Force  there 
was  great  dissatisfaction  with  the  assignments  made.  In  several  cases  ob¬ 
served  directly  by  research  personnel,  copilots  and  airplane  commanders 
were  reversed  in  their  assignment  by  their  directors  of  Training.  Further 
inquiry  revealed  that  many  of  the  copilots  in  operational  training  at  this 
time  had  been  two-engine  instructor  pilots  in  the  AAF  Training  Command. 
Orders  from  higher  headquarters  to  assign  these  pilots  to  combat  outfits 
caused  them  to  be  sent  on  to  operational  training  where  they  automatically 
became  copilots  since  they  had  had  no  4-engine  experience. 


Tabu  4J8 .-Comparisons  of  stanines  of  airplane  commanders  and  copilots 
B-17  AND  »-2«  CREWS-SECOND' AND  FOURTH  AIR  FORCES 


Duty  assitmnent 


Secor  1 -Ur  Force,  fint  half- -19M . 


Vcood  hatf— 1944. 


'"rati  Air  Force,  second  ball — 1944. 


In  utilizing  this  comparison  as  a  criterion  of  proficiency  it  is  presumed 
that  graduates  of  advanced  fiying  schools  were  assigned  to  duty  as  airplane 


comm?-:aers  or  copilots  on  the  basis  of  the  degree  of  competence  demon- 
stoied  to  date,  in  stanine  validation  it  is  also  assumed  that  the  assign¬ 


ment  was  done  without  knowledge  of  the  stanines  of  the  pilots  involved, 
it  b  believed  from  reports  of  procedures  used  at  advanced  schools  in  the 
AAF  Training  Command  that  the  pilot  stanine  was  not  often  utilized 
directly  in  making  the  decision  as  to  assignment.  However,  since  the  stanine 
(or  related  information)  did  enter  into  the  decision  as  to  whether  the  in- 
.  dividual  was  commissioned  as  a  Flight  Officer  or  Second  Lieutenant,  the 
criterion  is  open  to  objection  when  used  to  validate  the  stanine. 
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Teat  Validity 

The  validities  of  individual  Classification  Test  scores  were  computed  for 
a  small  sample  of  B~24  airplane  commanders  in  the  Fourth  Air  Foret 
Criteria  used  were  Instructors’  Ratings,  Link  Trainer  Grades  and  Cre* 
Average  Circular  Error.  AH  criterion  scores  were  converted  to  a  tv&. 
category  score  by  dividing  them  into  two  approximately  equal  groups  of 
upper  and  lower  half  scores.  Validity  coefficients  were  then  computed  a  : 
biserial  form.  The  data  are  shown  in  table  4J9-4.41.  j 

Only  a  few  of  the  individual  classification  tests  had  validity  coeffidenti  ■ 
that  differed  significantly  from  zero.  These  were  Mechanical  ^rindpks,  i 
CI903A;  Biographical  Data  (P)  and  (N);  CE602D,  and  Spatial  Orienta¬ 
tion  I,  CP501B. 


f 
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Tamxx  41r —Validities  of  stasdnes  and  classification  test  scons  for  instructors’ 
ratings  of  airplane  commander  (B-24)  proficiency 

BATTERIES  1,  1,  3.  4 


Test  variabka 


Bombardier  stanine . 

Navigator  itanine. . . 

Pilot  stanine. . . . ....  . . 

Rotary  pursuit  w/DA  CT!10B.. . 

Two  band  coordination  CM101A . 

Complex  coordination  Cm ’ISA . . 

Aiming strew  CE211A. . .... . . 

Discrimination  reaction  time  CP611D. ... 

Finger  dexterity  CM1KA...... . 

comprehension  CI614G . .  • 

Spatial  orientation  HCPSOSB . 

Spatial  orientation  I  CP 303 B... . 

Numerical  operations  ICI702B. . 

Numerical  operations  UCI702B . 

Biograpbicaldata  (P)  CE602D. . 

Biographical  data  00  CE602D . 

Speed  o 1  identification  CP610A. . . . 

General  Information  (NI  CE5Q5D . . 

General  information  (?)  CE5QSD . 

Mathematics  B  CI206C . 

Mathematics  A  C702F . 


N, 

Hi 

M. 

Mi 

SD. 

fib 

130 

59 

6.18 

5.68 

1.71 

-8.8 

130 

59 

6.06 

3.64 

1.76 

*.» 

129 

58 

6.20 

5.83 

1.51 

•JO 

106 

64 

51.51 

31.70 

9.55 

-M 

128 

58 

52.68 

31.64 

10.30 

.11 

130 

59 

52.16 

52.92 

9.69 

124 

56 

50.31 

48.91 

11.  SJ 

.14 

130 

59 

53.23 

52.22 

7.62 

.15 

130 

59 

50.12 

48.97 

11.10 

.11 

124 

56 

24.78 

23.68 

10.94 

.11 

124 

56 

63.27 

57.80 

18.01 

•MS 

130 

59 

36. 15 

35.20 

7.82 

.14 

130 

59 

22.19 

21.31 

6.82 

.11 

130 

59 

29.18 

25.80 

5.66 

-.11 

127 

59 

37.67 

36.15 

10.95 

.14 

127 

59 

34.04 

32.29 

11.21 

.11 

95 

46 

28.58 

27.76 

6.48 

.14 

95 

46 

23.01 

22.28 

3.16 

Ml 

127 

49 

33.20 

32.25 

7.59 

.IS 

95 

46 

21.36 

21.78 

5.56 

95 

46 

34.97 

35.15 

6. 12 

-.04 

95 

46 

16.96 

16.33 

9.03 

.« 

95 

46 

27.08 

25.48 

16.48 

.11 

Table  4.40. _ Validities  of  stanines  and  classification  test  scores  for  link  trainer  grain 

made  by  airplane  commanders  ( 3-24 ) 

BATTERIES  1,  2,  J.  4 


Test  variables 

Nf 

Ni 

M. 

Mi  I  SD. 

ru 

Rotary  pursuit  w/DA  CP410B  v . 

Discrimination  reaction  time  CP611D . 

Finger  deiterity.CMl  16A vv  - . . . 

Mechanical  principles  CI90  . . •'  . 

Dial  and  table  reading  CP(/2-21A  .  . . 

Spatial  orientation  11  CP5(  B . * . 

Numerical  operations  I  . . 

Biographical  data  (P)  CF-*02D. . . 

Biographical  data  (N)  CV  602D . 

137 

137 

138 
97 

135 

137 

ni 

137 

137 

131 

131 

137 

137 

137 

134 

134 

104 

104 

134 

104 

104 

104 

102 

82 

82 

84 

45 

82 

82 

80 

82 

82 

80 

80 

82 

82 

82 

81 

81 

63 

63 

81 

63 

63 

63 

63 

6.18 

6.01 

6.14 

r2.05 

j2.S« 

52.02 

50.45 

53.47 
49.93 
74.68 

62.63 
36.39 
22.31 
29.24 
38.28 

34.63 

28.63 
23.12 

33.47 
21.1; 
34.78 
16.88 
27  61 

6.07 
5.94 
6.00 
51.7 1 

51.55 
53.10 
50.09 
53.85 

51.20 
23.54 

60.56 
56.01 
22.07 
28.84 
38.02 
34.67 
27.60 
22.87 
33.64 
20.92 
34.83 
16.14 

26.21 

1.73 

2.C2 

1.54 

9.55 
10.37 

9.63 

11.55 
7.78 

10. 't 
ii 

17.82 

6.81 

6.88 

6.23 
1».58 
1..03 

6.44 

3.24 
7, « 
5.89 
6.51 
9.72 
16.85 

0.0! 

.« 

.04 

.15 

-.14 

,05 

-.00 

-.11 

.1* 

.11 

.00 

.05 

.10 

.01 

.0? 

MS 

J 

r.-s 

.u 
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Jtux  AMj—VtUdUits  #/  sirpu JW  (MM nierf  (B-24)  tlvtbut  m 4  cksdfictib*  UM 
scorti  for  crew  avtragt  circular  bombing  orrtc 
BATTZKU3  1,  1.  t,  4 


□ 

□ 

X* 

sn,  j 

Ok 

m 

60 

6.21 

4*0 

1  f 

.W 

iw*** . 

in 

60 

6.12 

■5X1 

Ksn 

— .00 

. * . 

m 

60 

6.20 

.06 

w/pa  rwiia . 

Kti 

46 

51.55 

52.75 

r*l 

EyWri 

I 

.21 

.M 

CJI101A...  ......  . 

isl 

56 

137 

60 

52.43 

32.47 

49.16 

U! 

57 

50.47 

.06 

137 

60 

51.  M 

K3 

.'N 

ui 

4C 

.U 

f  CWI4G . 

ini 

57 

-.10 

ff1  ciooia . T . . 

131 

$7 

tail 

12.99 

.06 

r.'V^jT.v.i-  fT6Il.UA . 

ui 

60 

56.46 

In  t* 

-.06 

11*0*5038 . 

us 

60 

22.62 

22.43 

v)  T* 

.01 

lii 

60 

26.99 

i 

*.20 

134 

ss 

38.23 

MlTt 

R  |  T« 

.06 

IIC1702B . 

134 

5* 

31.25 

Jr  i  tM 

-.Oi 

100 

45 

28. 45 

29.20 

6.23 

-.16 

infi?*  •*•»»  fN)  OK402D. . . .  . 

100 

45 

25.18 

23.40 

MW-* 

-.06 

134 

58 

33.14 

33.72 

»yrf 

-.06 

mfarxcAtSon  (N)  CE505D . 

100 

45 

21.46 

22.20 

Btri 

-.16 

r*  \  information  (P)  CESOJD . ' . 

100 

45 

54.90 

33.91 

6.49 

•  IT 

r  riM6(: . 

100 

45 

18.73 

16.20 

10.13 

06 

m 

45 

27.20 

30.62 

16.38 

.26 

_ 
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SUMMARY 

Aviation  psychologists  in  the  Continental  Air  Forces  spent  a  relatively 
large  proportion  of  their  time  and  energy  in  the  study  of  airplane  com¬ 
mander  proficiency  in  operational  training.  Conferences  were  held  with 
twining  personnel,  combat  crews  in  training,  and  personnel  experienced  in 
combat.  Intelligence  reports,  Training  Manuals  and  Directives  and  various 
training  forms  were  examined  and  studied.  These  activities  not  only  gave 
the  research  personnel  information  as  to  the  types  of  characteristics  needed 
for  success  in  operational  training,  but  they  also  provided  the  raw  material 
for  the  construction  of  several  instruments  designed  to  measure  proficiency 
in  that  training. 

A  large  number  of  possible  criteria  of  oroficiency  were  analyzed,  most 
of  which  turned  out  to  be  unacceptable  for  one  reason  or  another.  Because 
of  the  lack  of  suitable  objective  criteria,  aviation  psychologists  were  forced 
to  fall  back  on  ratings  and  other  subjective  judgments.  Among  the  sub¬ 
jective  criteria  studied  were  over-all  numerical  ratings  of  various  sorts, 
descriptive  ratings,  rankings,  mission  ratings,  check  list  ratings  and  self 
ratings.  Other  criteria  included  rate  of  training  accomplishment,  bombard¬ 
ment  scores  (both  average  circular  error  and  radar  bombing  scores), 
academic  grades,  ground  trainer  scores,  Flying  Evaluation  Board  reports, 
and  aircraft  accidents.  . 

Wherever  data  were  available,  study  was  made  of  the  validity  of  the 
stanines  of  airplane  commanders  in  predicting  proficiency  in  operational 
training.  It  was  found  that  pilots  removed  from  flying  status  by  Board 
action  and  pilots  having  aircraft  accidents,  as  a  group  bad  lower  stanines 
than  control  groups  of  other  pilots  in  training  at  the  same  time.  No  rela¬ 
tionship  was  found  between  pilot  stanine  and  bombardment  scores.  Whether 
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this  lack  of  relationship  was  due  to  various  attenuating  factors  such  as  tfe 
unreliability  of  the  bombing  scores  and  the  restriction  of  range  of  tin 
staninc  is  not  known.  Certainly  the  data  did  not  support  the  contention  of 
instructors  that  the  pilot  contributed  in  any  important  way  to  the  accuracy 
of  bombing.  Perhaps  beyond  a  certain  rather  low  level  of  performance  tin 
skill  of  the  pilot  did  not  make  much  difference  in  bombing. 

The  pilot  stanine  did  predict  to  some  extent  the  more  adequate  types  of 
ratings.  However,  the  coefficients  were  all  low.  Somewhat  higher  predictive 
values  were  oK*  'ned  in  the  prediction  of  training  accomplishment  i  ora 
and  ground  training  performance.  Among  the  ratings,  the  most  objective 
and  in  many  ways  the  most  interesting  were  the  ratings  on  the  Crew  Pro6- 
dency  Check— VHB.  Unfortunately  only  fragmentary  data  were  obtained 
and  no  condusions  regarding  their  use  are  possible. 


CHAPTER  FIVE. _ 

Copilot 


ANALYSIS  OF  DUTIES 

Job  Description 

The  copilot  on  heavy  and  very  heavy  bombardment  crews  served  ail  an 
assistant  or  understudy  of  the  airplane  commander.  In  this  caporit/  he 
was  supposed  to  be  familiar  with  every  duty  of  the  latter,  since  he  had  to 
be  able  to  take  the  place  of  the  airplane  commander  at  any  time.  On  long 
combat  and  training  Sights  the  copilot  and  airplane  commander  us&tlly 
took  turns  flying  the  plane.  On  landings  and  take-offs  the  copilot  » <*»«***! 
by  adjusting  flaps,  raising  and  lowering  wheels,  checking  instruments  and 
performing  various  operations  at  the  signal  of  the  airplane  commander. 
In  general,  in  operational  training  the  copilot  received  approximately  one- 
half  as  much  “stick”  time  as  the  airplane  commander. 

Other  duties  of  the  copilot  varied  considerably  with  the  tyne  of  aircraft 
and  the  specific  division  of  duties  worked  out  between  particular  airplane 
commanders  and  their  copilots.  The  copilot,  usually  performed  ail  or  part 
of  the  preflight  and  postflight  checks,  usually  under  the  supervision  of  the 
airplane  commander.  In  heavy  bombardment  crew.,  the  copilot  frequently 
served  as  engineering  officer  and  maintained  a  complete  log  of  power  plant 
performance.  He  thus  had  to  have  a  thorough  knowledge  of  cnise  control 
and  emergency  procedures.  In  many  cases  the  copilot  handled  routine  deal¬ 
ings  with  other  crew  members  for  the  airplane  commander  and  accomplished 
much  of  the  paper  work  with  respect  to  training  and  administration.  The 
tendency  grew  up,  particularly  in  some  of  the  combat  areas  and  in  B— 29 
training  and  combat  operations,  for  the  more  experienced  and  cider  pilots 
to  be  assigned  as  airplane  commanders.  The  position  of  copilot  then  served 
as  a  sort  of  apprenticeship  from  which  a  pilot  graduated  to  airplane  com¬ 
mander  status  after  a  given  amount  of  experience  in  combat. 

The  actual  training  of  the  copilot  was  very  similar  to  that  of  the  sir- 
plane  commander.  He  took  the  same  classes  in  ground  training,  flew  wjien 
the  airplane  commander  flew  and  had  few  special  duties  or  opportunities 
to  come  to  the  attention  of  training  supervisors.  The  copilot  thus  came  to 
be  the  least  well  known  of  the  aircrew  officers.  Flying  inst"  .ctors  some¬ 
times  did  not  even  know  who  were  the  copilots  of  the  crews  under  their 
instruction.  For  a  more  detailed  statement  of  the  training  requirements,  see 
the  material  under  the  corresponding  section  in  chapter  4,  Airplane  Com¬ 
mander. 


143 


AtuiIm  psychologists  i»  the  Second,  Third  and  Fourth  Air  Forces  eg*, 
ferrtd  with  training  personnel,  officers  with  combat  experience,  and  caoAg 
oiw  trainees  to  obtain  iaformatioe  about  qualities  and  skills  necessary 
success  as  copilot  ca  bombardment  am.  There  was  general  agreeagg 
that  the  primary  requisite  was  a  high  degree  of  proficiency  in  handling  ^ 
aircraft.  Of  especial  importance  were  proficiency  in  'ennation  and  ia  u- 
stnaneat  flying.  These  same  qualities  were  also  those  thought  meat  j*. 
portaot  for  success  in  lead  crew  assignment,  according  to  opinions  of  Second 
Air  Force  personnel  interviewed  about  lead  crew  proficiency.  Apparently 
there  were  few  or  no  differential  qualities  or  traits  for  copilots  as  Hieiw* 
from  those  required  for  success  as  airplane  commander. 

CRITERIA  OF  PROFICIENCY 

The  studies  of  criteria  of  proficiency  of  copilots  parallelled  those  for  air¬ 
plane  commander.  Hence  the  various  criteria  will  be  described  here  oriy 
in  sufficient  detail  to  provide  accurate  identification.  The  full  description 
may  in  each  case  be  found  in  chapter  4,  Airplane  Commander,  mwW  the 
section  on  Criteria.  In  this  connection  it  should  be  pointed  out  that  the 
amount  of  information  available  about  copilots  was  much  less  than  n 
available  for  airplane  commanders.  For  example,  it  was  sometimes  im¬ 
possible  to  obtain  subjective  ratings  of  copilots  in  CCTS  classes  in  opera¬ 
tional  training  because  none  of  the  instructors  or  supervisory  penomd 
felt  they  knew  the  copilots  well  enough  to  make  the  ratings. 

Rating*  of  Proficiency 

Over-all  Judgments 

Efficiency  ratings  on  WD  AGO  Form  66-2,  5-point  ratings  of  attitude 
toward  work,  ratings  on  the  Officers  Proficiency  Card,  AFTRC  Form  2  and 
rankings  in  flights  and  classes  were  obtained  on  small  samples  of  copilots. 
No  data  are  available  on  the  reliability  of  any  of  these  ratings  as  applied 
to  copilots. 

Descriptive  Ratings 

In  developing  procedures  for  measuring  lead  crew  proficiency  of  combit 
crews  in  operational  training,  two  sets  of  descriptive  rating  scales,  Scale  A 
and  Scale  B,  wer?  constructed  by  research  personnel  in  the  Second  Air 
Force.  Included  were  scales  for  rat'  ig  the  crew  as  a  whole,  scales  for  ratinj 
enlisted  gunners  as  a  group,  and  .cales  for  rating  each  aircrew  .-pedalty 
Details  of  the  construction  of  thse  scales  are  givtn  in  the  section  o* 
Criteria  in  chapter  4,  Ai«j.lane  C.  mmander.  In  both  Scale  A  aad  Scale  B 
the  items  included  for  the  ratinj  of  copilots  were  similar  to  those  in  fbe 
airplane  commano.-r  scales  which  were  described  in  chapter  4.  Scale  A 
was  used  to  rate  lfcO  B-29  ccpfloU  at  4  stations  and  Scale  B  was  used  to 
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rate  between  150  and  200  additional  copilots  at  another  4  stations,  Ead* 
copilot  was  rated  independently  by  two  or  more  instructors.  The  distribu¬ 
tions  of  the  totals  of  the  ratings  on  all  items  are  given  in  table  5.1  for  both 
The  correlations  between  the  ratings  of  two  instructors  are  given  In 
table  5.2.  The  data  show  that  the  reliability  of  copilots*  ratings  was  on If 
moderate  and  was  somewhat  lower  than  that  of  ratings  of  airplane  com* 
panders.  A  lower  reliability  for  the  ratings  of  copilots  Is  not  uneipected 
in  view  of  the  fact  that  copilots  were  much  less  wefl  known  to  the  raters. 

Tails  ?.l. — Distribution  of  descriptht  ratings  of  copiott 
SCALES  A  AK5  R-S-29  CREWS-SECOND  AIR  fOStCE 


Scoit  AS  Utmi 


Mttbsg: 

10  . 
11  . 
12  . 

13  . 

14  . 

15  . 
15  . 
17  . 


ToUl  rating  . . . 320  , 

Mean .  10S3 

SD.  . . . .  2j08 


Sait  B-7  lum 

J toting:  M 

6-  7  . .  17 

S-  t  . 10  « 

10-11  . 16 

12-13  . 22 

14- 15  . : . Si  1 

16-17  . 2S  " 

15- I9  . . 45 'i 

20-21  .  70  . 

22-23  .31 

24-2 S  . !... . . .  IS 

26-27  . . I  " 

20-29  . ‘  S  " 

30-31  .  1. 

32-33  . 1 

Total  rating  . 319  ( 

. . . 1642 

SD .  SJ4 


Table  52. — Reliability  of  ratings  of  copAtit 
B-19  CREWS— SECOND  AIR  FORCB 


Sol*  A: 
Alamofordo  1. 
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.34 
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.41 

-  ■  1  9 

26 

2.1* 

.42 

13  1 

1.17 

.12 

46 

2.77 

.44 

42 

2.49 

.13 

127 

2.47 

.71 

The  aircrew  officers  in  one  B-24  CCrS  class  in  the  Second  Air  Fore*, 
were  interviewed  by  an  Interview  Board  which  then  rated  each  copilot  on 
a  10-point  numerical  scaie  on  each  of  6  traits.  Furthc.  details  of  these 
ratings  may  be  found  in  chapter  4,  Airplane  Commander,  tinder  Criteria. 

145 


Tbe  correlations  between  the  Interview  Board  Rating  on  the  different 
traits  are  given  in  table  53.  The  negative  relationships  found  between  the 
trait  ratings  of  the  airplane  commanders  were  not  duplicat'd  here  with  the 
Copilots. 

Tails  5J. — CorrtUilons  between  Interview  board  ratings  of  it  trob » 


E-24  COPILOTS — 1ft- POINT  SCALE-SECOND  AIR  FORCE* 
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Performance  in  Ground  Training 

A  number  of  proficiency  measures  in  ground  training  were  studied  by  avia¬ 
tion  psychologists  in  the  Continental  Air  Forces.  Types  of  scores  studied 
with  B-17  and  £-24  copilots  were  academic  average,  grades  in  Engineering, 
Bombardment,  Communications,  Navigation  and  Gunnery,  Link  Trainer 
grades  or  ratings,  hours  taken  to  complete  Link  Trainer  check,  circular 
error  on  the  A-2  Bomb  Trainer  and  examination  scores  in  C-l  Autopilot 
and  Engineering.  A  small  amount  of  evidence  was  available  on  the  reli¬ 
ability  of  academic  grades.  The  correlation  between  Engineering  grade  in 
the  first  half  and  that  in  the  second  half  of  training  was  037  for  53  B-17 
copilots.  The  correlation  between  academic  average  for  all  courses  in  the 
first  half  jf  training  and  that  for  the  total  course  was  0.86  for  56  B-24 
copDcts.  The  latter  figure  is  spuriously  high  since  the  performance  of  the 
fir/,  half  was  probably  included  in  the  grade  for  the  total  course. 

For  56  copilots  at  one  station  in  the  Fourth  Air  Force,  the  odd-even 
reliability  of  Link  Trainer  ratings  for  5  missions  was  0.46. 

Miscellaneous  Criteria 

Crew  rate  of  accomplishment  of  training  requirements,  crew  bombing 
scores,  and  removal  from  flying  status  by  action  of  Flying  Evaluation 
Boards  were  also  studied  as  criteria  of  copilot  proficiency.  However,  there 
was  little  reason  to  expect  that  the  copilot  contributed  significantly  to  crew 
performance  in  the  first  two  types  of  measures.  And  in  the  Flying  Evalua¬ 
tion  Board  reports,  few  of  the  re-evaluated  pilots  were  reported  to  be  co¬ 
pilots.  Whether  this  vas  because  the  reports  frequently  did  not  contain 
the  necessary  inform.. tion  or  whether  the  copilot  actually  was  rarely  in¬ 
volved  in  Board  activn  was  not  certain.  Reports  of  instructors  and  others 
would  indicate  that  the  former  was  the  more  likely  explanation. 

Intercorrelation*  Among  Criteria 

The  correlation  i  between  various  criteria  of  proficiency  of  copilots  are 
shown  in  tables  '-A  and  5.5.  Correlations  ^‘veen  various  types  of  ratings 


la  the  Second  Air  Force  are  given  in  the  first  of  the  two  tables.  The  second 
table  gives  the  intercorrelations  among  certain  ground  training  proficiency 
criteria  and  an  over-all  rating  by  instructors.  In  bo  h  tables  coefficients  of 
correlation  are  given  above  and  to  the  right  of  the  diagonal  and  numbers 
of  cases  for  those  coefficients  below  and  to  th.  left. 

The  correlations  between  descriptive  ratings  and  certain  other  proficiency 
criteri-  were  determined  for  various  groups  of  A-29  copilots.  Ratings  of 
*  . 

Tabu  5 .4 . — C orrelati o%s  between  diferent  nstbep  of  copSots 
Z-'.l  AND  B-24  COPILOTS — SECOND  AI*  POtCB 


Typtrf  ntimf 


ComUOoM  bctvcca  nliac* 


Eficieacy»r»tiai.  hem  66-1 .  A .  w  931  #-g  °  jJ 

iSiiiiiii  j§  l  ■  3 

CtNiiAi  Nont—Eotiioi  bdow  the  ditcoul  *rt  the  number!  ot  case*  lor  the  axn**mA*m  Of. 
itUtio*  twflriw* 

160  B— 29  copilots  on  Scale  A  in  the  Second  Air  Force  were  found  to  cor¬ 
relate  0.00  and  0.02  with  academic  average  and  average  circular  error. 
These  coefficients  were  obtained  by  averaging  the  coefficients  for  the  four 
different  stations  involved.  For  39  copilots  of  B-29  crews  ia  the  Second  Air 
Force  the  correlation  between  ratings  on  descriptive  rating  Scale  B  and 

Tabu  S3.— Correlations  between  measures  of  proficiency  of  copAots 

B-24  CREWS— FOURTH  AIR  FORCE _ 


Corrclitkns  betweta  team 


Type  of  toon 


Over-tS  ratine . . .  « . 

Unk  L*iner  rating .  5 . 

A-2  circular  error. ..... . . 

C-l  autopilot  waioinadoo..... .  it"'" 

Emineenn<  oaminattra . *  6  "  * 


A 

41 

40 

40 

-0.16 

41 

41 

102 

GnnnAL  Non — Entries  betow  the  dU*orul  ere  the  uumbm  ol  for  0*  «««*«&«  we¬ 
re  la  don  coettdrata. 

number  of  hours  to  complete  Link  Trainer  requirements  was  0.1S.  ^ 

other  44  copilots  at  another  station,  the  biserial  co*re  .  .  Trainer 

on  Scale  B  and  whether  or  not  the  copflots  completed  their  Link  Trainer 

Check  was  0.2S. 

Evaluation 

An  adequate  evaluation  of  criteria  of  proficiency  for  copflots  is  diffknJfc 
with  the  small  amount  of  data  available.  Because  ey  were  so 
to  instructors  and  training  personnel  there  is  g  rea^°°  °  , 

validity  ot  ratings.  For  example,  for  8  CCTS  dasses  ' of] 
crew?,  instructors  ranked  the  aircrew  officers  in  their  lg 
their  expected  effectiveness  in  combat.  The  average  (  y 
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relation  between  the  ranks  given  airplane  commanders  and  those  give* 
copilots  in  the  different  CCTS  classes  was  0.68.  It  would  seem  rather  ob¬ 
vious  that  a  copilot  was  usually  ranked  in  the  class  or  flight  according  to 
what  the  Instructors  thought  of  the  airplane  commander. 

Performance  on  ground  trainers  would  seem  to  be  the  best  of  the  avail¬ 
able  criteria  for  a  number  of  reasons.  The  scores  represented  observations 
or  records  of  actual  performance  and  were  thus  not  influenced  by  lack  of 
knowledge  of  the  individual  in  the  way  the  over-all  and  descriptive  ratings  * 
were.  Similarly  the)'  were  not  affected  as  much  by  various  forms  of  sub¬ 
jective  bias  since  attention  of  the  observers  was  focussed  on  actual  perform¬ 
ance.  The  chief  disadvantage  to  ground  trainer  scores  was  that  they  did 
ndt  necessarily  represent  the  type  of  activity  actually  performed  in  the  air. 

VALIDATION 


The  correlations  between  the  augmented  pDot  stanines  of  B-17  and 
B-24  copilots  in  the  Second  Air  Force  and  various  types  of  ratings  of  po5- 
ciency  are  shown  in  table  5.6.  Except  for  the  Interview  Board  ratings, 
none  of  the  coefficients  differ  significantly  from  zero.  The  latter  coefficient 
is  based  on  such  a  small  number  of  cases  that  its  practical  significance  is 
open  to  question. 

In  table  5.7  are  shown  the  correlations  between  the  stanines  of  B-29 
copilots  and  descriptive  ratings  in  Scales  A  and  B  in  ..ie  Second  Air  Force. 


Tabu  S.6.—Correlations  between  augmented  pilot  stanines  and  ratings 
B-17  AND  B-24  COPILOTS-SECOND  AIR  FORCE 
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«> 
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Th;  coefficients  shown  are  averages  (  by  Fisher’s  *)  of  separate-  coefficients 
for  each  station  and  class.  None  are  significantly  different  from  zt:-' 
Correlations  between  augmented  pilot  stanines  of  B-17  and  B-24  copilots 
and  various  criteria  of  performance  in  ground  training  are  shown  in  tabk 
5.8.  Only  the  coefficient  for  the  engineering  grades  was  significantly  (<  5 


Tabu  S.7. — Correlations  between  snnines  of  copilots  and  ratings  by  instructors 


SCALES  A  AND  B.  B-.'i  CREWS-SECOND  AIR  FORCE 
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Pilot  f  Cr . 
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1.51 

2.58 

.58 

.04 
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percent)  different  from  zero.  For  the  CCTS  class  of  54  B-24  crews  to  the 
table  above  the  navigator  and  bombardier  stamina  of  the  copilots  wen 
found  to  better  predict  navigation  and  bombardment  grades  than  ‘id  the 
pilot  stanine.  The  coefficients  were  0J1  for  bombardier  stanine  against 
Bombardment  grade  and  0.18  for  navigator  stanine  against  Navigator 
grade.  Finally  the  navigator  stanine  was  also  found  to  better  predict 
academic  average.  For  the  211  copilots  in  the  first  line  of  table  5.8  tha 
correlation  between  navigator  stanine  and  academic  average  was  J7,  For 


Tajlx  S».— Correlations  between  autmented  pUct  stanine  end  ground  training  criteria 
B-17  AND  B-24  COPILOTS — SECOND  AH.  FORCE 
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157  B-29  copilots  in  the  Second  Air  Force,  upper  and  lower  half  desig¬ 
nations  were  available  for  performance  in  ground  school.  The  coefficients 
of  correlation  between  augmented  pilot  stanines  of  these  copQots  and  per¬ 
formance  in  ground  school  averaged  (by  Fisher’s  a)  was  —0.02. 

In  table  5.9  are  shown  the  correlations  between  pilot  and  navigator 
stanines  and  performance  on  the  Link  Trainer.  Two  types  of  scores  were 
available,  hours  to  complete  Link  Trainer  requirements  and  whether  or  not 
the  Link  Trainer  check  was  completed.  The  latter  score  was,  of  course,  a 
sort  of  pass-fail  criterion  and  those  coefficients  were  biserial  in  form.  It 
was  interesting  that  the  navigator  stanine  seemed  to  predict  to  a  greater 
extent  the  copilots’  performance  in  the  Link  Trainer  than  did  the  pilot 
stanine. 

In  chapter  4,  Airplane  Commander,  it  was  reported  that  records  of  more 
than  1,200  crews  in  24  CCTS  (H)  classes  were  analyzed  to  determine  the 


Table  5.9.— Correlations  between  stanines  of  copilots  and  link  trainer  performance 
b-29  CREWS— SECOND  AIR  FORCE 
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I  =  Did  not  complete  Link  Uainec  check. 
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cumber  of  training  requirements  completed  at  the  end  o'  A  weeks  of  opera, 
tional  training.  Among  tie  copilots  of  these  crews,  803  were  found  to  have 
taken  the  Aircri  w  Classification  Tests.  The  correlation  between  the  aog. 
mected  pilot  stanine  of  these  copilots  and  the  number  of  training  require. 
aenM  completed  b>  their  crews  at  the  end  of  6  weeks  vt  is  0.03.  This  wai 
obtained  by  converting  separate  correlations  by  classes  to  equivalent  a 
values  and  obtaining  the  weighted  average.  Separate  correlations  by  classes 
tanged  from  0.34  to  — 0J7. 

In  the  Fourth  Air  Force,  data  were  obtained  at  the  Lead  Crew  School 
at  AAF  Muroc  on  the  relaUon  between  B-29  crew  bombing  scores  and  the 
stances  of  various  crew  members.  The  correlations  between  the  bombar¬ 
dier,  navigator  and  pilot  sta nines  of  the  89  copilots  and  crew  average 
circular  error  vere  —0.11,  —0.07  and  —0.03  respectively.  Where  extreme 
bombing  errors  were  excluded  to  give  a  normal  aiming  error  score,  the 
coefficients  were  —0.02,  —0.06  and  0.00.  The  correlations  between  the 
stanines  and  percent  of  bombs  on  which  gross  errors  were  made  were  — 0.09, 
0.02  and  — 0.01.  These  coefficients  show  there  was  essentially  a  zero  re- 
lationship  between  copilot  stanines  and  bombing  scores. 

SUMMARY 

Because  the  copilot  served  on  bombardment  crews  merely  as  a  sort  of 
assistant  to  the  airplane  commander,  it  proved  to  be  difficult  to  obtain  ade¬ 
quate  measures  of  his  proficiency  in  combat  type  operations.  Training 
personnel  frequently  did  not  know  the  copilots  well  enough  to  rate  their 
performance.  Thus  it  was  not  surprising  that  the  estimates  of  proficiency 
obtained  were  less  reliable  and  less  useful  in  studies  of  the  validity  of 
aptitude  scores  or  stanines,  chan  similar  criteria  obtained  for  airplane  com¬ 
manders. 

In  general  the  stanines  of  copilots  were  found  to  bear  no  relation  to  iheir 
success  in  operational  training,  at  least  as  measured  by  most  pf  the  criteria 
studied.  Performance  on  the  Link  Trainer  and  certain  ground  school  grades 
were  exceptions.  The  navigator  and  bombardier  stanines  were  found  to 
predict  academic  success  better  than  did  the  pilot  stanine.  While  there  was 
some  evidence  the  pilot  stanines  of  copilots  predicted  their  Link  Trainer 
Performance,  the  available  data  indicated  such  performance  was  better 
predicted  by  their  navigator  stanine. 


150 


chapter  six 


Navigator 


ANALYSIS  OF  DUTIES 

i  l 

Job  Description 

Information  concerning  the  duties  of  the  navigator  in  operational  training 
was  gathered  by  psychological  research  personnel  in  the  Second,  Third  and 
Fourth  Air  Forces  as  a  part  of  their  mission  to  discover  and  evaluate 
criteria  of  navigator  proficiency.  The  following  brief  description  of  the 
duties  of  the  navigator  in  operational  training  is  derived  from  observations, 
interviews  with  instructors,  material  found  in  Army  Air  Forces  Training 
Standard  20-2-1,  Army  Air  Forces  Manual  35-1  and  the  training  directives 
of  the  three  Continental  Air  Forces  concerned  with  the  training  of  navi¬ 
gators. 

The  essential  job  of  the  navigator  was  to  obtain  and  use  such  navigational 
aids  as  would  help  him  bring  the  plane  to  its  destination;  to  maintain 
throughout  the  flight  a  current  record  of  where  the  airplane  was  and  tos 
furnish  a  log  of  the  entire  mission  upon  its  completion.  In  the  accomplish¬ 
ment  of  this  assignment,  the  navigator  was  required  to  perform  any  one  or 
all  of  the  following  specific  tasks: 

1.  Make  a  preflight  check  of  equipment- 

2.  Obtain  thorough  briefing  instructions  as  to  destination,  course,  time  of 
arrival,  expected  areas  of  flak  and  hostile  interception,  and  weather. 

3.  Navigate  over  land  or  sea  by  dead  reckoning,  pilotage,  celestial  means 
or  radio. 

4.  Navigate  by  use  of  instruments  such  as  dnftmeter,  pelorus,  aircraft 
octant,  radio  compass,  aperiodic  compass  and  loran  equipment. 

5.  Compute  effects  of  various  factors  on  course  and  plot  projected  course 
on  the  chart 

6.  Maintain  log. 

7.  Request  radio  bearings  and  make  periodic  position  checks  by  this 
means. 

8.  Furnish  other  crew  memoers  data  on  wind  direction  and  velocity, 

ground  speed  and  drift  on  any  heading.  '  > 

9.  Check  data  for  errors  after  flight  and  recalibrate  all  navigation  in 

struments  if  necessary. 

10.  Perform  duties  of  bombardier,  gunner,  copilot  or  radio  operator 
in  emergency. 

11.  Send  and  receive  radio,  telegraph  and  blinker  code. 
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In  addition  to  these  particular  duties  the  navigator  in  operational  training 
was  required  to  provide  the  airplane  commander  and  crew  with  technical 
information  about  machine  guns,  deflection  problems,  and  the  effect  of 
weather  on  military  operations.  In  some  crews,  the  navigator  was  desig. 
nated  as  crew  personnel  equipment  officer. 

Job  Specifications 

In  determining  the  skills,  knowledge,  etc.,  considered  desirable  for  the 
navigator,  information  was  obtained  from  the  following  sources:  Flying 
Evaluation  Board  case  records,  interviews,  and  questionnaires. 

Flying  Evaluation  Board  Records 

For  the  period  from  January  to  October  1944,  Fourth  Air  Force  Flying 
Evaluation  Board  reports  on  IS  navigators  revealed  3  major  categories  of 
causes  for  referral  to  local  boards.  Table  6.1  lists  these  categories  and  the 
frequencies  with  which  they  were  cited  as  principal  cause  for  Flying  Evalua¬ 
tion  Board  action. 

• 

Tabs  6.1. — Principal  causes  of  flying  evaluation  board  action  on  navigators 
JANUARY  TO  OCTOBER  1944 — FOURTH  AIR  FORCE 

NumSm 


Came  of  action: 

Physical  disability  . 2 

Lack  of  proficiency  . . . ' . . .  J 

Personality  defect! 

Fear  and/or  neurosis  . S 

Personal  misconduct  . 1 

Lack  of  maturity  . . .  1 

ToUl . ; . IS 


Of  the  16  cases  of  navigators  appearing  before  Flying  Evaluation  Boards 
in  the  Third  Air  Force  du.iug  1944,  all  but  1  were  re-evaluated  becavse  of 
“personality  difficulties.”  jince  the  term  covered  a  wide  range  of  causes, 
this  result  provides  little  insight,  except  to  corroborate  the  Fourth  Air 
Force  finding  that  personality  factors,  rather  lack  of  proficiency  vere 
responsible  for  most  of  the  failures  in  training.  Due  to  the  small  numbei  of 
cases  and  the  inadequ.  cy  of  records,  Flying  E  Nation  Boarc  proceedings 
were  not  particularly  -ruhful  in  providing  information  about  the  oasirabk 
characteristics  of  navigators. 

Interviews 

In  an  attempt  to  ascertain  the  characteristics  of  successful  lead  crew 
navigators,  aviation  psychologists  interviewed  returnee  pilots,  bombardiers 
and  navigators  who  had  fi.own  in  squadron,  group  and  wing  lead  positions 
in  combrt.  The  consensu  of  these  officers  from  different  theaters  as  to 
the  qualifications  needed  for  each  crew  member  was  determined  by.analjsis 
of  these  interviews.  No  r/ttempt  was  made  to  scale  the  qualifications  rela¬ 
tive  to  their  importance  f  r  lead  crew  position  in  combat.  The  following  is » 
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list  of  the  qualifications  obtained  in  the  Second  Air  Force  by  this  inter*' 
view  technique: 

1.  General  high  proficiency  in  a3  phases  of  navigation. 

2.  Very  high  proficiency  in  celestial  navigation,  (Pacific  Theaters, 

mainly). 

S.  Very  high  proficiency  in  pin-point  navigation. 

4.  Knowledge  of  formation  flying.  * 

5.  Foresight  and  anticipation  in  formation  flying. 

•  r  ■ 

Questionnaires 

On  the  basis  of  observations  during  training  flights,  examination  of  train* 
ing  directives  and  informal  talks  with  flight  instructors,  a  list  of  10  factors 
considered  important  for  the  successful  completion  of  Fourth  Air  Force 
training  was  obtained.  Instructors  were  then  asked  to  rank  these  items  In 
order  of  importance  and  after  completion  of  the  ranking,  to  suggest  «M* 
tional  factors  which  they  considered  important  for  the  successful  navigator. 
The  reliability  of  instructors’  judgments  of  the  relative  importance  of  items 
was  determined  by  combining  the  ranking:  made  by  instructors  at  all  three 
bases,  correlating  the  average  rank  assigned  by  odd  instructors  with  that 
assigned  by  even  instructors  (regarding  items  as  individuals)  and  adjusting 
the  coefficient  by  the  Spearman- Brown  formula.  With  17  instructors,  the 
reliability  coefficient  thus  obtained  was  0.88.  In  other  words,  the  hierarchy 
as  a  whole  was  highly  reliable. 


Tails  62.— Order  of  importance  of  items  os  ranked  by  instructors  and  os  indicated  by 
correlation  between  item  ratings  and  over-all  ratings 

B-24  NAVIGATORS- FOURTH  AIR  FORCE _ 
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In  table  6.2  are  given  the  average  ranks  given  each  item  together  with 
the  standard  deviation  of  the  ranks.  The  latter  are  important  in  that  they 
indicate  the  extent  of  agreement  among  instructors  as  to  the  importance  or 
lack  of  importance  of  the  various  items.  There  was  relativ  y  g 
ment  that  ability  in  D  R  navigation  was  most  important,  that  ability  in 
pilotage  was  about  middle  in  importance  and  that  conscientiousness  of  log 
procedure,  ability  in  radio  navigation  and  likeableness  were  0 
portance.  The  lack  of  importance  attributed  to  radio  raviption  may  have 
been  due  either  to  a  belief  that  the  procedures  were  so  simple  navigators 
bad  little  trouble  with  them,  or  to  the  fact  that  its  use  was  contingent  upon 


153 


7MJJO-47— 11 


the  presence  of  radio  installations,  which  were  not  then  plentiful  in  the 
combat  area  ft  i  which  these  navigators  were  being  trained.  It  is  interesting 
that  conscientiousness  in  log  procedure,  which  was  greatly  stressed  in  train* 
tag,  was  thought  of  such  little  importance.  As  with  the  airplane  commander 
ta  chapter  4,  “eagerness"  or  motivation  was  considered  the  most  important 
trait  or  personal  characteristic,  although  there  was  less  agreement  among 
instructors  than  for  the  other  items  mentioned  above. 

Navigation  instructors  were  also  asked  to  rate  each  navigator  they  had 
checked  out  as  “above"  or  “below  average"  with  respect  to  each  of  the 
factors  described  above.  In  addition,  they  rated  each  navigator  as  to  over¬ 
all  proficiency  and  ability.  Separate  sheets  of  paper  each  with  a  list  of  the 
navigators  in  the  Section  were  used  for  each  item  ta  order  to  mlnfmjw 
halo  effects.  By  comparing  the  importance  of  each  item  as  expressed  ta  the 
ranking  of  the  items  by  instructors  with  the  relative  degree  of  correlation 
between  ratings  of  navigators  on  the  item  and  their  over-all  ratings,  it  was 
possible  to  see  how  much  agreement  there  was  between  these  two  ways  of 
estimating  trait  importance.  In  table  6.2  are  shown  the  10  items  listed  in 
oroer  of  their  importance  as  ranked  by  the  instructors.  Also  shown  is  the 
relative  importance  in  terms  of  size  of  correlation  between  ratings  on  the 
items  and  over-all  ratings.  There  is  seen  to  be  good  agreement  between 
what  traits  the  instructors  said  were  most  important  when  they  ranked  the 
items  and  what  traits  were  considered  most  important  when  they  rated  the 
navigators. 

Additional  items  suggested  by  instructors  as  being  important  to  training 

success  were  ;n  the  order  of  frequency  of  mention:  general  intelligence, 

maturity,  ability  to  assume  responsibility  and  cooperation  with  bombardier. 
* 

CRITERIA 

Particular  Criteria 

Mission  Grades  t 

Navigators  entering  B-29  Combat  Crew  Training  Station  (CCTS)  train¬ 
ing  in  the  Second  Air  Force  were  given  a  special  10-day  course  in  over- 
water  navigation  at  AAF  Jackson,  Miss.  Usually  this  course  was  given 
prior  to  regular  CC  dS  crew  training.  Each  navigator  was  expected  to  fly 
three  standard  missions  which  were  select*!  from  a  group  of  nine  missions, 
six  over  water,  and  tl  ree  over  land,  the  latter  being  flown  when  weather  did 
not  permit  over-waU  i  flights.  Grading  of  missions  was  in  terms  of  a  3-point 
scale,  with  points  a.<  .igned  as  follows:  Very  Satisfactory,  3  points;  Satis¬ 
factory,  2  points;  aid  Unsatisfactory,  1  point.  Reliabilities  of  navigation 
mission  grades  are  she  wn  in  table  6.3. 

In  the  Fourth  Air  T'orce,  also,  from  time  to  tine,  in  some  sections  at  some 
bases,  student  navigitors  rendered  reports  on  thur  navigation  flights.  The 
following  kinds  of  e  ors  were  reported; 

I.  Average  error  lines  of  position  (LOP). 
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2.  Average  hourly  error  of  estimated  tine  of  arrival  (ETA). 

3.  Course  error  per  60  miles. 

These  reports  were  subject  to  an  indeterminate  amount  of  distortion  be* 
cause  the  reports  were  made  out  with  the  assistance  of  other  crew  members. 
From  base  to  base  within  the  Fourth  Air  Force,  from  section  to  section  at 
the  same  base,  and  from  month  to  month  at  the  same  base  there  was  no 
consistent  policy  requiring  the  submission  of  mission  reports.  Mission  re- 
ports,  therefore,  as  used  in  the  Fourth  Air  Force,  were  of  practically  no 
value  as  criteria. 


Tabu  6J. — Reliabilities  of  mission  grades  and  error  scant 
B-29  NAVIGATORS — JACKSON  AAJF — SECOND  AIR  tXM.CZ 
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Mission  Error  Scores  . 

In  addition  to  the  ovrr-c^  grade  assigned  a  navigator  for  the  missions 
flown,  records  were  maintained  at  AAF  Jackson  of  the  ETA  (estimated 
time  of  arrival)  and  course  errors  for  each  leg  of  the  mission.  Number  of 
legs  varied  from  one  to  four  depending  upon  the  particular  mission  being 
flown.  In  general,  position  was  corrected  by  the  instructor  at  the  start  of 
each  leg  so  that  cumulative  errors  were  not  involved  in  these  measures. 
In  table  6.3  are  given  the  correlations  between  average  ETA  and  course 
errors  of  different  missions.  The  ETA  errors  were  recorded  in  minutes  and 
the  course  errors  in  miles.  It  can  be  seen  that  the  objective  error  scores 
of  different  missions  had  almost  zero  reliability.  There  are  of  course  many 
sources  of  variability  responsible  for  this  outcome.  Seme  of  these  are 
weather,  differences  in  difficulty  of  missions,  differences  in  emphases  on 
diflerent  missions  and  instrumental  errors.  Space  does  not  permit  of  an 
exhaustive  analysis  in  this  volume,  A  more  detailed  account  of  factors  in¬ 
fluencing  these  errors  may  be  found  in  Report  No.  10,  Psychological  Re¬ 
search  on  Navigation  Training. 

Log  Grades 

An  examination  of  Second  Air  Force  student  navigator  logs  revealed  that 
the  usual  grade  given  was  “satisfactory.”  Occasionally,  a  log  was  marked 
unsatisfactory,  incomplete,  or  not  graded.  It  was  believed,  after  isc  on* 
with  staff  navigators,  that  log  grades  were  not  a  good  representation  of  the 
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htindarf  jwdfncnts  o f  the  quality  o I  Btrifitios  ow  tke  ■kafaw.  Sewed 
lop  were  examined  V7  the  Pybolopal  Section,  AAF  Tnawf  Co» 
Biaod,  to  dettraiie  vbdler  aajr  method  of  objective  scoring  coaid  he 
devised.  .It  ns  ioawd  posable  to  estimate  fairly  accnratdy  the  tne 

from  examination  of  al  the  kp  of  a  formation.  .It  was  then  possible 
to  assign  more  or  less  objective  grades  to  the  indhridaal  lop  apoa  the  bom 
of  deviation  from  the  tne  path.  However,  since  the  amoont  of  labor  m- 
voived  in  this  procedme  made  this  type  of  analysis  almost  knpomMe  to  me 
on  1  large  scale,  father  *todies  of  thss  type  were  abandoned.  Considerable 
inference  was  also  involved  in  the  procedure  concerning  which  phaes 
actually  constituted  the  formation.  Thb  information  was  not  food  in  »V 
lop  • 

In  the  Third  Air  Fccr  the  log  of  each  navigator  for  every  training  flight 
was  graded.  Log  grades  were  based  upon  completeness,  neatness  and  exact* 
ness  of  computations.  The  care  and  objectivity  of  grading  varied  from 
station  to  station.  For  23  cases  at  Bnisdiie  Field,  Class  0912,  the  odd- 
evess  log  grade  re5abtTity  was  found  to  be  0.70. 

The  lack  of  usifornaty  of  grading  procedures  makes  it  difficult  to 
-  evaluate  the  potentialities  of  the  log  grade  as  a  criterion.  In  its  present 
mtstaedardized  state  this  treasure  is  of  little  value  as  an  index  of  prd6riaxy 
in  navigation  training  in  the  Continental  Air  Faeces. 


Two  sets  of  Second  Air  Force  navigator  instructors  ranked  the  student 
navigators  in  their  flights  in  the  order  of  their  expected  proficiency  in  com¬ 
bat.  For  one  class  of  56  student  navigators  the  coerdatko  between  the 
2  sets  cf  rar  kings  was  0.63.  For  another  class  of  56  stndrnt  navigators, 
efficiency  ratings  (Form  66-2)  for  2  periods  of  training  were  svtelahV 
The  correlation  between  these  two  sets  of  ratings  was  found  to  be  035. 
Additional  evidence  regarding  the  degree  of  reliability  of  subjective  ratb*s 
of  navigators  can  be  obtained  from  an  examination  of  the  corrdatkcs  be¬ 
tween  different  sets  of  ratings  as  shown  in  tables  6.4,  6.5  and  6.6. 

The  efficiency  and  cfficer  quality  ratings  shown  in  table  6.4  were  ratings 
by  insfvur-tors  on  a  &  e-point  scale:  Superior,  excellent,  very  satisfactory, 
satisfactory  and  unsat  -.factory.  Actually,  observers  rarely  used  more  that 
the  top  three  ratings,  rhe  ratings  by  instructors  on  the  three  qualities  of 
AFTRC  Form  2  were  on  a  three  point  scale:  above  average,  average  and 
below  average.  Rank  i »  class  was  based  on  a  listing  of  officers  in  order  of 
anticipated  proficiency  ■  combat  These  rating;,  may  or  may  not  have  been 
done  by  the  same  observer.  The  interview  ratr/.gs  in  table  6.5  were  on  8 
qualities  using  a  10-poii  scale,  and  represent  .be  consensus  of  the  inter¬ 
view  board.  The  sum  of  bese  ratings  was  used  /or  interview  board  ratings 
in  table  6.6.  The  flight  :orgeon  ratings  on  the  s  .me  table  were  on  a  three 
point  scale:  above  ave»ge,  average  and  below.  Crew  ratings  were  the 
average  of  ratings  on  a  .0-point  scale  on  9  traits  by  three  other  members 


of  the  crew.  Sdf  ratings  were  the  sun  of  ratings  on  9  quaBtfcs,  usfof  a 
10-potnt  scale  foe  each.  Thus  an  of  the  ratings  in  table  6.6  were  r*rAt  by 
Afferent  Individuals  and  were  relatively  Independent 
Affloog  the  factors  entering  inio  all  ratings  and  rankings  are  the  experi¬ 
ence  and  prestige  of  the  individuals  being  rated.  One  would,  therefore,  ex¬ 
pect  that  first  lieutenants  and  captains  would  be  given  higher  ratings 
would  flight  officers  and  second  lieutenants.  From  the  ratings  In  table  6.4, 

T MMXX  M-— Condotions  between  tiferent  ratings  of  SWol  inff*in 

»-»  navigators— second  an  rates 
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Taxu  6-5- — Condition. s  between  interviews  bond  ratings  of  mn  traits 
B-24  NAVIGATORS — 10-POCCT  SCALE-SECOND  ADt  FORCE 
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Tablx  6-6. — Correlations  between  (liferent  ratings 
B-!4  NAVIGATORS— SECOND  ADt  FORCE 
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a  composite  rating  score  was  prepared  for  each  navigator  and  the  average 
composite  score  determined  for  two  groups:  those  first  lieutenant  and  above 
in  ran);,  and  those  second  lieutenant  and  below.  The  biserial  coefficient  of 
correlation  between  composite  ratings  and  rank  was  0.45  from  the  totil 
group  of  52  navigators.  However,  not  all  of  this  correlation  was  necessarily 
due  to  "halo”  since  to  a  certain  extent  higher  rank  was  a  reflection  of  addi¬ 
tional  experience  and  ability.  * 

In  an  attempt  to  develop  an  instrument  for  the  evaluation  of  B-29  lead 
crew  proficiency  in  the  Second  Air  Force,  two  descriptive  rating  scales, 
Scale  A  and  Scale  B  were  developed.  Both  scales  consisted  of  a  number  of 
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items  upon  which  ratings  from  !  to  5  were  to  be  made,  l  in  each  case 
being  the  most  favorable  rating  and  5  the  poorest  rating.  Some  of  the  Ittn* 
were  the  same  for  all  crew  positions.  Others  varied  from  position  to  po* 
tioo.  Scale  A  was  administered  at  Clovis,  Alamogordo,  Davis-Monthan  and 
Biggs,  and  ratings  with  this  scale  were  obtained  from  instructors  for  160 
navigators.  Ninety-two  navigators  from  AAF  Albuquerque,  Pyote,  Walker 
and  Great  Bend  were  rated  by  their  instructors  on  Scale  B.  In  each  case 
rating  were  obtained  from  at  least  two  independent  observers  for  each  of 
the  individuals  and  crews  rated.  The  correlations  between  independent 
ratings  on  both  scales  are  shown  in  table  6.7. 

Tabu  6.1— Reliability  confidents  of  mini  scale  total  scorn 
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COMWTMn  (By  »# . - . 

At  all  bomber  bases  in  the  Fourth  Air  Force,  performance  ratings  of 
student  navigators  were  made  by  the  squadron  navigator  in  conference  with 
flight  instructors.  Although  the  ratings  were  made  upon  the  conventional 
army  5-point  scale,  rarely  were  more  than  3  points  actually  used,  and  in 
most  cases  approximately  90  percent  of  all  students  were  placed  at  the 
“Excellent”  point  on  the  scale.  The  lack  of  spread  in  these  ratings  made 
them  practically  useless  for  statistical  analysis. 

A  rating  scale  consisting  of  11  items  was  administered  to  Fourth  Air 
Force  B-24  navigator  instructors  at  Muroc,  Walla  Walla  and  March  Field. 
(A  later  and  greatly  modified  B-24  scale  was  developed  too  late  for  ad¬ 
ministration.)  The  items  for  ratings  were  selected  upon  the  basis  of  ob¬ 
servations  during  training  flights,  examination  of  training  directives,  and 
informal  talks  with  flight  instructor.  In  response  to  the  items,  instructors 
were  requested  to  rate  (half  abov  \  -average,  half  below-average)  all  the 
students  whom  they  had  check-riddo.  In  order  to  minimize  “halo”  effect, 
the  item;  were  administered  success!, ely  on  separate  sheets  of  paper  upon 
which  were  typed  the  names  of  all  st  idents  in  the  section.  Item  reliabilities 
in  the  rating  situation  could  be  comp  ited  for  only  one  sample  of  21  Muroc 
student  navigators  for  whom  two  or  a, re  ratings  were  available.  The  items 
of  the  rating  scale,  together  with  ther  reliabilities  (rut),  appear  in  table 
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Research  personnel  In  the  Fourth  Air  Force  assisted  in  the  construction 
of  a  rating  scale  for  use  in  the  Lead  Crew  School  at  Muroc  Army  Air  Base. 
This  scale  required  instructors  to  rate  navigators  on  seven  items:  prcpua* 
lion  for  mission,  technique,  accuracy,  scope  interpretation,  turn  procedure, 
interphone  procedure  and  bombing  team  coordination.  In  addition,  the  In* 

Tails  6 Jt. — RtliabtUiUt  of  navitator  rattxg-tcoU  Mowtt 
21  NAVIGATORS  MUROC  AAR— FOURTH  AIR  FORCE 


1.  What  ii  your  over-all  rating  of  the  student  as  a  navigator? . 0.40 

2.  How  eager  is  the  student  to  learn  his  job  as  navigator  r .  M 

S.  How  well  does  the  student  get  along  with  his  other  crew  members? .  22 

A.  How  well  does  the  stud<  Jt  perform  in  an  emergency  situation?  . .  .90  • 

5.  How  likeable  is  the  student  as  a  person? .  jOO 

6.  How  good  is  the  student's  knowledge  of  navigation  equipment? .  JOO 

7.  How  good  is  the  student’s  DR  navigation? .  j09 

V  How  good  is  the  student’s  celestial  navigation? .  jfiO 

9.  How  good  is  the  student’s  pilotage?  .  M 

10.  How  conscientious  is  the  student’s  log  procedure?  . 

11.  How  good  is  the  student’s  radio  navigation?  .  JS 

structor  was  asked  to  make  an  over-all  estimate  of  the  navigator,  particu¬ 
larly  in  terms  of  his  potentialities  as  a  lead  navigator.  Two  scores  were 
evaluated  for  reliability:  the  average  grade  (the  average  of  the  grades  on 
the  seven  items)  and  the  over-all  grade.  Table  6.9  shows  the  reliability 
coefficients  that  were  obtained  by  correlating  the  average  rating  of  the  odd 
instructors  with  those  of  the  even  instructors,  corrected  by  the  Spearman- 
Brown  formula.  The  considerable  drop  in  reliability  for  both  scores  after 
the  first  class  was  thought  to  be  in  large  part  due  to  increasing  administra¬ 
tive  difficulties  which  curtailed  greatly  the  number  of  ratings  on  each 
navigator. 

Table  6.9— ReliabOitki  of  navi  [at  or  ralinii 
MUROC  AAF— FOURTH  AIR  FORCE 
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Ground  Trainer  Grades 

1.  Celestial  navigator  trainer. — The  Celestial  Navigator  Trainer  (CNT) 
simulates  many  of  the  flying  conditions  which  confront  a  navigator  in  actual 
flight.  The  trainer  was  so  constructed  as  to  provide  objective  measures  of 
the  students’  performance  from  the  graphic  records  of  the  course  flown  * 
by  the  student.  These  measures  were:  number  of  celestial  fixes,  average 
celestial  fix  error,  average  error  of  estimated  time  of  arrival  (ETA),  average 


track  error,  cumber  of  radio  fixes  and  average  radio  fix  error.  In  practice, 
these  objective  scores  were  not  always  systematically  recorded.  Frequently 
each  of  the  student's  four  to  eight  missions  on  the  trainer  was  rated  by  * 
instructor  who  professed  to  take  into  account  both  the  quality  of  the  pej. 
formance  and  the  objective  scores.  In  both  the  Second  and  Fourth  Ak 
Forces  the  missions  were  divided  into  the  two  categories  of  simple 
complex. 

The  data  in  table  6.10  indicate  the  reliabilities  of  the  ratings  or  grades 
and  the  reliabilities  of  objective  scores  were  similar  in  magnitude,  although 
the  comparison  is  somewhat  hazardous  in  view  of  the  differences  in  numbers 
of  cases,  etc.  Somewhat  lower  reliabilities  for  objective  scores  are  reported 
in  table  6.11  for  56  student  navigators  at  Sioux  City. 

In  this  same  study  it  was  found  that  if  only  successful  missions  were  in¬ 
cluded  the  reliability  of  the  scores  was  not  significantly  affected. 


T*bu  6.10. — Reliability  coefficients  of  CNT  scores  and  mints 


B-17  AND  B-24  NAVIGATORS— SECOND  AIR  FORCE 


Type  ot  CNT  grade  of  soon 

Number 
of  CUM* 

■ 

746 

rrl 

*12 

tarf 

142 

l  M 

36 

M 

36 

.» 

54 

.n 

*  Not  correct*!  by  Spearaun-Browa  Formula. 


Tabu  6.11. — Reliability  coefficients  for  CNT  objective  scores 


ODD-TVEN  MISSIONS— SIOUX  CITY— SECOND  AIR  FORCE 


Score 

1 

N 

1 

|  Odd  mminnt.  1 

Even  minions,  2 

B 

Mesa 

S.D. 

M  tu 

KOI 

Number  at  fin • . 

54 

KS3 

0.60 

3.98 

0.74 

0.56 

At.  petition  error . ' . 

56 

2.14 

8.53 

2.26 

.11 

ETA  error. . . 

54 

in 

1.55 

2.83 

1.57 

Distinct  error . 

f 

50 

Hi 

4.1* 

6.62 

J.tS 

.11 

t 

Table  6.1?  present:  reliability  coefficients  for  CNT  ratings  from  two 
other  air  forces.  In  ge\  eral,  these  coefficients  resemble  those  shown  in  table 


6.10. 

Tabu  6.12. — Otd-even  reliabilities  of  CNT  ratings  of  navigators 
HURD  AND  FOURTH  AIP,  FORCES 


Base 

Air 

force 

Number 
of  caret 

fl 

Wells  Wells . 

■ 

56 

0.0 

44 

50 

.11 

Msrcb  Field . 

.» 

Gulfport  (Class  0731) . 

35 

45 

.0 

_ _ _ 

In  the  Fourth  Air  h  vee,  correlations  were  obtained  between  objective 
scores  ,and  ratings,  and  il  e  resulting  coefficients  ai«  presented  in  table  6.13’ 
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Xbt  results  suggest  that  the  two  variables  were 'as  highly  correlated  as  could 
be  expected  in  view  of  the  low  reliability  of  each. 

Tasu  6.13.— Correlation  btlvee «  CNT  objtdHt  team  mi 
instructors  ratmgs  cj  CNT  fcrjmwsmc* 

SO  KAVIGATOKS— FOCKTH  AIK  POfcCX 
CrrrtUsi—  Schrtta  tt)nSh*  km  md  butrxUrf  ^jf 


CNT  Scans 
Staple  missoBs  (61  miofcm): 

Number  of  celestial  fixe* . 0l37 

Average  celestial  fix  error  .  *} 

Number  CF  plus  CF  error  (equaSy  wetted)  .  AO 

missions  (39  mimom): 

Number  of  celestial  fixe*  .  J4 

Average  celestial  fix  error  .  J6 

ETA  error  . J6 

Track  error  .  31 

Number  CF,  CF  error,  ETA  error,  track  error,  (equally  weighted) .  .76 


The  wide  range  of  reliability  coefficients  for  both  types  of  scores,  to¬ 
gether  with  small  samples  for  several  types  makes  generalizations  with  re¬ 
gard  to  the  adequacy  of  CNT  scores  difficult  However,  since  some  degree 
of  reliability  was  found,  the  various  scores  were  regarded  as  of  sufficient 
value  to  be  useful  for  validation  purposes. 

2.  G-l  trainer— The  G-i  Trainer  provided  training  in  dead  reckoning. 
Student  navigators  in  the  Second  Air  Force  were  rated  on  a  6-point  scale 
(0,  very  poor,  to  S,  excellent)  for  each  of  5  to  ’0  missions.  For  a  group  of 
560  student  navigators  an  odd-even  mission  reliability  of  .28  was  obtained 
for  these  ratings. 

Academic  Grades  - 

.  i 

Tests  and  grades  covering  various  aspects  of  academic  courses  were  in 
use  at  practically  all  training  bases.  There  was,  however,  no  uniformity 
from  basr  co  base  either  in  the  construction  of  the  tests  and  their  sub¬ 
sequent  use  or  in  grading  procedure.  Many  of  the  tcs*s  were  administered 
but  r,.‘ver  graded.  Some  were  graded  but  the  grades  were  not  recorded.  In 
tna'.}  cases  the  tests  served  “to  encourage  study”  or  “to  help  the  student 
n-iew.”  In  the  majority  of  academic  courses  taken  during  navigator  train- 
jg  the  “grade”  consisted  of  a  notation  that  the  student  had  attended  the 
required  number  of  hours  for  completing  the  course. 

A  split-half  reliability  of  0.18  for  navigation  grades  was  obtained  for  56 
cases  in  the  Second  Air  Force.  For  a  similar  group  in  a  bombardment 
course  the  correlation  between  first-half  and  second-naif  grades  was  0.12 j 
rhe  average  intercorrelation  of  three  phases  of  gunnery  grades  was  0.60. 
The  tests  upon  which  these  grades  were  based  were  not  available  for 
lamination.  Lack  of  uniformity  in  construction,  administration  and  grad- 
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bf  of  tests  la  academic  subjects  makes  it  difficult  to  evaluate  acadeoic 

trades. 

Crtm  ACE 

A  detailed  descriptor!  of  this  criterion  is  given  in  Chapter  7  in  the  sectioa 
on  bombing  scores.  The  use  of  bombing  error  scores  as  criteria  of  navigator 
proficiency  requires  a  special  word,  however.  It  bas  been  stated  repeatedly 
that  bombing  scores  reflect  to  a  certain  extent  the  ability  of  all  members  tt 
the  crew.  The  navigator  was,  however,  a  minor  assistant  in  the  risoi 
bombing  task.  Radar  bombing  permitted  the  navigator  to  play  a  more  im¬ 
portant  role.  The  navigator  was  equipped  with  a  radar  scope  and  in  some 
crews  he  actually  performed  the  duties  of  the  radar  observer  and/or  bom- 
hardier  during  the  bombing  procedure.  There  was,  however,  no  uniformity 
from  crew  to  crew  with  respect  to  the  division  of  duties  among  the  members 
of  the  radar  bombing  team,  hence  there  was  no  way  of  determining  the  ex¬ 
tent  to  which  the  navigator’s  proficiency  was  reflected  in  crew  radar  ACE. 

Because  of  the  possibility  that  a  navigator’s  proficiency  might  affect  ttx 
accuracy  of  a  crew’s  bombing,  the  radar  ACE  score  was  regarded  as  a 
potentially  useful  criterion,  especially  since  it  was  moderately  reliable.  For 
example,  radar  bombing  data  obtained  at  Muroc  Army  Air  Field  had  a 
odd-even  mission  reliability  coefficient  of  .69  for  102  cases.  In  the  Second 
Air  Force  the  odd-even  mission  reliability  coefficient  was  0.61  for  219  cases. 

Flying  Evaluation  Board  Records 

As  stated  above,  records  of  Flying  Evaluation  Board  proceedings  were 
not  regarded  as  suitable  for  criterion  purposes  because  of  the  small  number 
of  cases  and  the  inadequacy  of  the  data  recorded. 

Accomplishment  of  Training  Requirements 

In  the  Second  Air  Force,  it  was  possible  to  obtain  the  mission  and  train¬ 
ing  accomplishment  scores  for  1,200  crews.  The  scores  were  the  number  cf 
training  requirements  completed  at  the  end  of  6  weeks.  This  score  was 
subject  to  a  number  of  criticisms  as  a  criterion  of  navigator  proficiency. 
The  rate  at  which  a  crew  accomplished  its  training  responsibilities  was  af¬ 
fected  by  many  factors.  The  ability  of  the  navigator  was  probably  not  a 
major  determinant  It  was  not  possible  to  determine  the  reliability  of  the 
scores. 

Intercmdations 

Tables  6.14,  6. :5,  6.16  and  6.17  present  interconrelations  among  me**" 
ures  of  navigator  proficiency  in  each  air  force  in  which  navigators  were 
trained.  The  res.  Its  are  not  comparable  frem  table  to  table  since  different 
scores  arc  comj  '.red  and  in  the  case  of  sin  liar  scores  different  conditions 
doubtless  obtaued.  However,  the  general  impression  is  one  of  little  or  bo 
correlation  be  .ecn  the  scores.  The  results  j  resented  in  table  6.16  appe** 
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to  contradict  this  generalization,  since  the  bombing  scores  were  moderately 
laterconelated  as  were  the  rating  scores  (to  some  extent).  It  should 
noted,  however,  that  the  bombing  scores  were  actually  different  methods 


evaluating  the  same  bombing  performance.  The  correlation  between  rating 
jalc  scores  is  doubtless  due  to  “halo,”  since  the  different  scores  were  prob- 


L 


Tabu  6.14. — Correlations  beiiccm  dig  ami  tyfa  of  criteria 

B-I7.  *-24  AND  B-J9  CREWS— SECOND  AH  rates 


Tabu  6.15. — I nler correlations  ament  measures  of  navitator  proficiency 
BARKSDALE  FIELD — THIRD  AIR  FORCS 


CNT 

B5 

orr . 

0.71 

•  » 
.1 

i.4» 

.If 

43 

Lag  fades. . . . . . 

4$ 

J* 

s  a 

t*w«rrehifif . . _ . 

41 

40 

40 

1 _ ! 

Gmui  Not* — Es  tries  below  ike  dugoaal  are  Ike  number*  oi  cues  tea  Ike  riwr^i—Oleg  ter- 
~jCbod  nsOHwIl. 


Tabu  6.16. — Intercorrelations  among  measures  of  navitator  proficiency 
B-24  KAVIGATORS — FOURTH  AIR  FORCE 


Code 

A 

B 

H 

D 

D 

D 

O 

A . 

0.26 

inn 

0.2* 

0.0* 

-0.21 

-0.JJ 

l  CVTratmTT . 

B . 

143 

fifth; 

-.04 

.06 

-.13 

.00 

c . 

143 

147 

-.01 

.12 

-.30 

-.37 

D  .... 

54 

36 

34 

1  C*i  tnifio  rad&g . 

E . 

40 

40 

40 

-.2* 

.01 

F . 

40 

40 

40 

40 

.47 

G . 

40 

40 

40 

40 

40 

CtsitSM.  Not* — Entries  below  tie  dia*ooal  sre  tie  number  of  cues  far  tie  correspootfia*  cor- 
coefBdeata. 
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Tabu  6.17. — Correlations  among  measures  of  navitator  proficiency 
B-29  CREWS— FOURTH  AIR  FORCE  _ 


.  ACE  total . . 

ACE  ootbJ  lia. , 

fa  cratirou  errors. 


*N  =  101. 


Code* 


0.74 


0.17 

.45 


0.1* 

.17 

.19 


0.30 

,U 

.21 

.70 
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ably  assigned  by  the  same  instructors.  The  correlations  between  rath* 
scores  and  bombing  scores  are  low  and  corroborate  the  low  intercorrdatioe} 
found  in  other  tables.  The  low  intercorrelations  among  the  measures  of 
navigator  proficiency  are  doubtless  due  in  part  to  the  low  reliabilities  c ( 
most  of  the  variables. 

Evaluation  of  Criteria 

Because  at  many  bases  mission  grades  were  made  out  with  the  assistance 
of  other  crew  members,  these  reports  were  subject  to  an  indeterminate 
amount  of  distortion.  From  base  to  base,  from  section  to  section  at  the 
same  base,  and  from  month  to  month  at  the  same  and  different  bases  there 
was  no  coexistent  policy  requiring  the  submission  of  mission  reports.  For 
these  reasons  mission  reports  were  of  little  value  as  criteria  of  success  in 
navigator  training.  Even  the  more  standardized  grading  of  B-29  missions 
at  Jackson  AAF  yield  quite  low  reliability  coefficients. 

j _^rV  of  uniformity  among  and  within  bases  in  the  maintenance  and 
grading  of  logs  makes  it  difficult  to  evaluate  the  potentialities  of  log  grades. 
Although  a  method  of  estimating  true  flight  path  from  an  examination  of  all 
of  the  logs  of  a  formation  was  developed  and  it  was  possible  to  assign 
relatively  objective  grades  to  the  individual  logs  on  the  basis  of  indicated 
deviations  from  the  true  path,  the  amount  of  labor  involved  in  this  proce-  i 
dure  makes  this  type  of  analysis  almost  impossible  to  use  on  a  large  scale. 
The  fact  that  a  moderately  high  reliability  coefficient  was  obtained  far  i 
small  sample  in  the  Third  Air  Force  suggests  that  log  grades  are  potentially 
a  valuable  criterion,  if  grading  procedures  are  standardized.  Rating  scales 
showed  some  promise  as  criteria  of  proficiency  in  navigator  training.  In 
general,  whenever  it  was  possible  for  psychological  personnel  to  control,  at 
least  in  part,  the  conditions  under  which  scales  of  their  own  design  wen 
administered,  and  when  ratings  were  given  at  the  same  base  by  individuals 
in  the  same  administrative  relali.  \ship  to  the  men  being  rated,  the  rating 
scales  yielded  moderately  high  ’’ability  coefficients.  However,  the  in¬ 
fluence  of  subjective  factors  make,  them  less  satisfactory  than  would  be 
indicated  by  the  reliability  coefficier  *s  obtained. 

The  value  of  CNT  ratings  and  -rades  was  reduced  by  the  lack  of  re¬ 
liability  of  both  the  objective  ard  subjective  measures.  More  careful 
recording  of  the  “objective”  measu:  is  and  the  insistence  upon  a  standard¬ 
ized  procedure  for  evaluating  theso  measures  might  produce  a  grade  or 
rating  that  would  rove  to  be  a  satisfactory  criterion  of  navigator  train¬ 
ing  proficiency. 

The  present  lao.  of  uniformity  ir.  construction,  administration  and  grad¬ 
ing  of  tests  of  a .  ademic  subjects  n  ade  academic  grades  of  little  value  as 
validation  crite  -a.  If  pass-fail  reqiirements  could  be  enforced  and  if  test¬ 
ing  conditions  ould  be  standardize.,  there  is  little  doubt  that  reliable  tests 
of  proficiency  n  academic  courses  -3uld  be  devised. 
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>fbe  little  work  that  has  been  done  in  determining  the  relationship  of 
navigator’s  ability  as  measured  by  a  rating  scale  and  radar  average  circular 
error  is  promising.  Such  measures  of  proficiency  will  doubtless  become 
jnore  important  as  emphasis  is  placed  on  the  performance  of  the  crew  as  a 

whole. 

The  number  of  Flying  Evaluation  Board  cases  and  the  inadequacy 
of  the  reports  themselves  as  to  possible  reasons  for  reevaluation  render 
this  source  of  little  value  as  a  criterion. 

Two  general  observations  might  be  made  in  connection  with  evaluation 
0{  all  the  criteria.  First,  it  is  obvious  that  for  practically  all  the  available 
criteria  it  was  difficult  to  obtain  comparable  data  from  station  to  station 
and  from  time  to  time  at  the  same  station.  Secondly,  it  must  be  noted 
that  there  was  no  simple  administrative  procedure  for  eliminating  students 
who  lacked  proficiency  in  their  navigator  training.  Because  of  this  lack, 
training  personnel  saw  little  value  in  trying  to  make  fine  distinctions  as  to 
proficiency.  This,  in  turn,  made  it  difficult  to  introduce  new  measures  of 
proficiency  or  to  make  much  progress  in  refining  existing  measures. 


VALIDATION  STUDIES 
Mission  Error  Score*  1 

Unfortunately,  no  validity  data  were  available  for  mission  grades  at  AAF 
Jackson  in  the  Second  Air  Force.  However,  the  ETA  and  Course  Error 
scores  obtained  were  compared  with  the  navigator  stanines  of  the  navigators 
concerned.  As  would  be  expected  from  the  nearly  zero  reliability  of  these 
scores,  the  validity  coefficients  of  the  stanines  against  these  criteria  were 
not. significantly  different,  from  zero. 


Log  Crade* 

Data  from  both  the  Second  and  Third  Air  Forces  indicate  little  relation¬ 
ship  between  the  stanines  of  navigators  and  navigation  log  grades.  For  a 
sample  of  S3  cases  at  Biggs  Field,  the  correlation  between  the  navigator 
Xante  and  log  grades  was  0.10.  For  44  B-29  navigators  ^  class  0807 
Barksdale  Field,  coefficients  were  -0.08,  0.03,  0.01  and  0. 
bombardier,  navigator,  pilot  and  pilot  plus  credit  stanines,  respective  y. 


Ratings 

Table  6.18  lists  the  correlations  between  each  of  a  number  of  ratingsof 
student  navigators  in  the  Second  Air  Force  and  navigator  stanines. 
efficiency  ratings,  ratings  of  attitude  toward  wor  ,  o  cer  qu  i 
nical  aircrew  skill  were  all  five-point  ratings  of  Ae  usual  type  ^ready 
cussed  in  Chapter  IV  and  ranged  from  “unsatisfactory  ^  P  • 
practice  few  ratings  other  than  “very  satisfactory  or  excellent 
given.  Ratings  of  general  aircrew  ability  and  flight  surgeons  rating  were 
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on  a  three-point  scale  of  above  average,  average  and  below  average.  Inter, 
view  ratings,  self  ratings  and  crew  ratings  were  IC-point  ratings  on  a  total 
of  8  traits  or  characteristics.  Rankings  were  obtained  by  having  instructor! 
rank  the  navigators  in  their  flights  or  classes  ir  order  of  their  expected  png. 

Takx  6.18. — Correlations  f  'ween  navigator  stanine  and  ratings 


»- 17  AND  R-24  NAVIGATO'  S — SECOND  AH  FORCE 


Criterian 

Number 

at 

casta 

Navigator 
alanine,  t 

Criterion,  t 

*» 

Mean 

S.D. 

Mena 

&.D. 

Efficiency  rating  64-1 . 

156 

7.37 

1.15 

41.1 

ll.S 

Iff 

Rankings  by  in*  true  tor* . 

211 

7.3* 

I.U 

50.1 

1*.* 

.ft 

Technical  aircrew  skill. . 

5t 

7.59 

.99 

42.9 

9.4 

t|| 

Officer  quality  mirr . . . 

51 

7.59 

.99 

37.3 

10.* 

a* 

Central  aircrew  ability . 

4* 

7.59 

1.21 

47.9 

to.e 

.ft 

Attitude  toward  work . . . 

192 

7.65 

J.10 

2.19 

.4 

«.» 

Interview  rating* . 

SJ 

7.6* 

.90 

5.99 

3.2 

-.11 

53 

7.6* 

.90 

2.02 

.4 

-.0 

Sell  rating . 

53 

7.6* 

.90 

2.77 

.9 

.ft 

Crew  rating . 

53 

7.6* 

.90 

7.02 

2.4 

-.ft 

ciency  in  combat  None  of  the  correlations  between  sta nines  and  ratings  of 
different  types  is  significant  except  that  for  the  “Attitude  Toward  Work” 
rating  which  yielded  a  correlation  with  navigator  stanine  significant  at  the 
1  percent  level.  In  addition  to  the  rankings  listed  in  table  6.18,  ranking 
of  Second  Air  Force  student  navigators  by  their  instructors  were  secured 


Tabu  6.19. — Correlations  between  total  rating  seal*  scores  and  stanmes  oj  navigaton 


SUM  OF  TWO  RATERS.  16th  AND  17  th  WINGS-SECOND  AIR  FORCS 


Station 

Stanine 

N 

Stanine,  1 

Rating 

acale  score*,  t 

ra 

Mean 

S.  D. 

Mean 

S.D. 

Scale  A: 

N. .  . . 

22 

7  45 

0  84 

20.68 

2.82 

0.38 

N . 

20 

7.50 

1.07 

18.00 

3  ,  02 

—  .02 

Riff*  fold . 

N . 

37 

7.51 

1.00 

23.32 

4.10 

—  .06 

Clovk. . 

N . 

35 

7.54 

.99 

22.62 

4.24 

.00 

Tticaaa . 

N . 

36 

7.42 

.98 

22.44 

4.66 

—  .12 

N . 

150 

7.4S 

.98 

21.82 

4.38 

.00 

o.oi 

B . 

150 

6.75 

1.55 

21.82 

4.38 

.09 

.ft 

All  station* . . . 

p . 

150 

5.97 

1.75 

21. *2 

4.3* 

.06 

.ft 

Scale  B: 

pyote . 

N . 

46 

37 

7.52 

1.12 

2*  98 

7.48 

7.52 

.13 

N . 

7.  *9 

1.  SI 

27.18 

—  .07 

Walker  . 

N . 

42 

7.69 

;.iv 
f  .09 

25.22 

6.48 

8.96 

.10 

Great  Bend . 

N . 

37 

7.81 

25.46 

.25 

All  tUtioot . . 

N . 

162 

7.56 

1.15 

26.78 

7.20 

.12 

.11 

All  tUtiooi . . . 

B . 

162 

6.71 

1.62 

26.7* 

7.20 

.13 

.1* 

All  station* . 

P . 

162 

5.91 

1.67 

26.78 

7.20 

•».2I 

-.11 

1  Coefficient*  were  combined  toe  the  lUtlon*  by  converting  into  “a”  equivalent*  and  *1*  ^ 


combining  all  data  directly. 


from  a  number  of  CCTS  classes.  For  a  group  of  721  student  navigaton 
these  rankings  correlated  0.04  with  navigator  stanine.  Results  presented 
in  table  6.19  indicate  that  there  was  little  or  no  relationship  between  tN 
stanines  of  navigators  and  descriptive  rating  scale  scores.  In  the  case  of 
Scale  B,  there  is  a  low  but  statistically  significant  correlation  between  rat¬ 
ings  and  the  pilot  stanine  of  the  navigator. 
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CfOttfld-TnOaer  Grades 

Correlations  between  navigator  stanines  and  ground-trainer  grades  in 
the  Second  Air  Force  are  presented  in  table  6.20.  The  navigator  stanine  is 
jboirn  to  have  a  significant  relationship  to  CNT  average  mission  grades. 
Ib  the  Third  Air  Force,  on  a  sample  of  60  B-29  navigators,  no  significant 
correlation  was  found  between  the  CNT  grades  and  the  stanines;  the  co¬ 
efficients  being  0.18  for  the  bombardier,  0.03  for  the  navigator  and  Oj02 
for  the  pilot  stanine. 

Task  6 JO. — Correlations  between  navigator  stanines  and  ground  trainer  grade t 
i  second  ant  rcaca 
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ss 

Academic  Grp.de* 

Correlation^  between  measures  of  academic  success  in  the  Second  Air 
Force  and  navigator  stanines  are  listed  in  table  6.21. 

The  navigator  stanines  appear  to  be  significantly  related  to  grades  in  the 
gunnery  navigation  examinations.  Several  other  of  the  coefficients  approach 
significance.  In  another  study  in  the  Second  Air  Force  when  150  navigators 
were  divided  into  “upper”  and  “lower”  groups  based  on  tbe  toul  of  all 

Table  621. — Correlations  between  navigator  stanine  and  academic  grades 


SECOND  AIR  FORCE 
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7,31 

1.4! 

13.1 
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55 

?  *4 

1.41 

1*41 

47.4 

la# 

1^*4 

54 

7  u 

72.6 

y.i 

4.1 

*.24 

55 

ground  school  grades,  the  navigator  stanine  showed  no  relationship  to 
ground  school  performance.  At  Pyote  Army  Air  Field  for  a  o 

46  B-29  navigators  the  correlation  between  the  navigator  stanino  and  the 
navigation  final  examination  was  0.47  which  is  .significant  at  the  1  percent 
level.  In  the  Third  Air  Force,  for  a  class  of  23  navigators,  the  navigator 
stanine  correlated  *0.45,  significant  at  the  S^percent  level,  with  average 
ground  school  grades. 

Accomplishment  of  Training 

There  were  921  student  navigators  out  of  1,200  heavy  bombardment 
crews  for  whom  mission  and  training  accomplishment  records  as  well  aa 
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Kuma  «crS  trtibbie  Tie  corrdttus  fr-feca  tbe  atvylor  stasa*, 
mj  the  **-*wh»*  of  reggrenests  cor^ted  at  (be  cod  of  6  ostfa 

by  Ik*;  crow  was  sot  sp&aaiy  different  frees  aero.  The  a  axSoey 
for  24  dasses  with  a  total  N  of  921  was  — CuQ2. 

Ctcv  ACS ' 

The  remits  of  wo  sta&es  comparing  tbe  taripted  aaaoc  for  i« 
ytalty  vitb  tbe  ry*»r  “bcesbusg”  record  of  the  ce*  of  ahicb  be  oat  a 
axober  are  rbon  is  table  6_22.  Tbe  bcifibfrg  scores  erf  tbe  tine  tjpe 
occurring  is  tie  Seo»d  Air  Force  study  west  cserrerted  into  T-scores  far 
cadi  siataoo.  These  scores  were  then  combined  directly  to  obtain  tbe  cw 
rfSdeat  for  zS  tbe  sutkos.  Is  tbe  data  from  the  Fourth  Air  ?  ea  tie  sepa¬ 
rate  tod5df.’(s  for  tbe  three  classes  were  ccarbioed  is  a  weighted  avuajr 
using  Faber’s  <. 
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Radar  bombing  scores  is  the  Fourth  Air  Force  were  analyzed  in  greater 
detail  to  yield  two  types  of  scores.  “Gross  errors”  were  extreme  erra 
thought  to  be  caused  by  failure  to  aknriff  the  target.  Since  the  magnitude 
of  such  errors  did  not  V-'x.i  significant  the  measure  used  was  the  per¬ 
centage  occurence  of  such  errors  (over  6,000  feet).  The  other  score  « 
the  “normal  aiming  error’  utilizing  all  scores  with  errors  of  less  than  6,000 
feet-  With  91  navigators  at  AAF  Muroc  the  validity  of  the  navigaicr 
si j  nine  in  predicting  these  scores  was  0.12  and  0.03  respectively,  for  the 
gross  error  and  normal  aiming  error  scores.  Although  not  statistical^ 
significant,  the  larger  coeSrient  obtained  with  tbe  gross  error  score  indi¬ 
cates  this  score  may  merit  further  study.  One  would  expect  that  navigatks 
errors  might  result  in  failure  in  finding  tbe  target 

In  general,  there  appeared  to  be  little  evidence  of  relationship  betwtt* 
navigator  stanines  and  bonding  r  measures. 

Flying  Evaluation  Board  Records 

In  both  tK  Second  and  Third  Ai.'  Forces,  the  stanines  of  navigators  who 
met  Flying  Evaluation  Boards  weic  compared  with  non-FEB  cases.  I3 
the  Third  A  r  Force,  a  sample  of  13  ’iminees  was  compared  with  a  control 
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poe p  of  U.  No  statistically  significant  differences  were  found.  The  same 
k$  also  found  in  tbe  Second  Air  Force,  is  a  larger  study,  coag*r> 
eg  tbe  staiu'pes  of  113  FEB  navigators  with  s  group  of  noa-FEB  nrvig*-. 
loo  satdiicf  tbe  former  as  to  time  of  taping  tfij  trainigg  The  neap 
j-rr^r*  Ot  duninated  navigators  was  6.76  as  co^ared  with  6.96  for  the 
ojetnb,  a  difference  not  sgnificantiy  different  from  what  might  be 
lychaace. 

la  general,  tbe  stanines  of  navigators  shewed  little  relationship  to  the 
erasures  of  navigator  ffigbt  proficiency  that  were  available.  However,  the 
agrigalcr  starune  was  significantly  related  to  several  measures  of  gmmui 
proficiency  and  io  some  ground  trainer  scores.  These  results  call  for 
ymf  general  comments  concerning  tbe  circumstances  under  which  tbe  above 
research  was  conducted. 


SUMMARY 

Base  to  tbe  job  of  predicting  success  in  navigational  training  in  tbe 
Continental  Air  Forces  is  tbe  problem  of  obtaining  reliable  and  represent** 
the  measures  of  tbe  success  that  is  to  be  predicted.  Continental  Air  Force 
trrnhtg  was  designed  to  meet  military  commitments  rather  than  to  provide 
a  laboratory  for  psychological  studies.  Each  station  complied  with  basic 
training  directives  in  a  way  which  made  it  possible  to  meet  its  own  require¬ 
ments.  From  tbe  point  of  view  of  training,  variation  among  bases  in  com- 
pfonr#-  with  training  directives  was  justified  on  tbe  basis  of  expediency.  This 
variation  was  especially  great  in  tbe  recording  of  data  concerning  grades, 
ratings,  etc,  of  almost  every  aspect  of  training.  The  difficulty  of  obtaining 
comparable  data  from  station  to  station  and  from  time  to  time  at  the  same 
Uartnn  it  very  hard  to  obtain  satisfactory  criteria  for  validation 

pwposes. 

The  problem  of  obtaining  criteria  was  further  complicated  because  no 
simple  administrative  procedures  existed  for  the  elimination  of  nonprofioent 
students.  The  lack  of  such  procedures  made  it  difficult  to  convince  train¬ 
ing  personnel  that  there  was  iny  vaiue  in  measuring  proficiency. 

In  the  few  situations  when  psychologists  were  able  to  adapt  standard 
psychological  procedures  to  the  training  situation  and  to  administer  such 
procedures  under  even  moderately  standardized  conditions,  it  was  possible 
to  obtain  reasonably  reliable  measures  of  proficiency.  This  would  suggest 
that  satisfactory  criteria  could  probably  be  obtained  if  the  pressure  of 
training  were  relaxed  sufficiently  to  permit  the  introduction  of  the  controls 
acd  standardization  lacking  during  the  war.  It  is  quite  likely,  however, 
that  many  apparently  objective  criteria  of  proficiency  such  as  errors  in 
estimated  lime  of  arrival,  course  error:  and  the  like  are  influenced  by  so 
many  variables  that  they  cannot  be  relit  upon,  even  under  more  standard- 
med  procedures.  Unless  reliable  measur*  are  developed,  it  is  doubtful  if 
the  predictive  efficiency  of  the  present  cor.  "site  aptitude  scores  (stanines) 
for  operational  training  can  be  materially  r<  "-sd. 
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One  further  comment  concerning  the  validity  coefficients  obtained  sho«H 
be  made.  The  range  of  stanines  was  severely  restricted  by  the  selection 
procedures  in  effect  in  the  Training  Command.  The  only  trainees  permitted 
to  heg»w  navigator  training  had  extremely  high  stanines.  Thus  In  opera¬ 
tional  training  conditions  were  favorable  for  high  stanine  navigators  to  get 
low  as  well  as  high  criterion  scores  and  thus  attenuate  the  validity  co> 
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chapter  seven. 


Bombardier 


ANALYSIS  OF  DUTIES. 

Job  Description 

To  supplement  the  formal  job  analysis  of  the  bombardier  made  by  Psy¬ 
chological  Research  Project  (Bombardier)  (found  in  Report  Number  9: 
Psychological  Research  on  Bombardier  Training)  aviation  psychologists 
in  the  Continental  Air  Forces  gathered  information  on  tfcs  job  cf  the  bom¬ 
bardier  in  operational  training  from  a  number  of  sources  Interviews  with 
instructors  and  bombardiers  with  combat  experience,  AAF  Training  Stand¬ 
ard  20-2-1  and  directives  of  individual  air  forces  provided  a  broad  orienta¬ 
tion  to  the  nature  of  the  task  which  was  sufficient  to  meet  the  needs  of  the 
research  sections.  The  following  is  a  brief  digest  of  some  of  the  material 
from  these  sources. 

The  ultimate  task  of  the  bombardier  was  to  locate,  identify  and  ac¬ 
curately  bomb  assigned  targets  from  a  bombardment  airplane.  In  order  to 
accomplish  this  the  bombardier  had  to  adjust  his  bombsight  and  related 
equipment  according  to  specific  conditions  such  as  ground  speed,  altitude 
and  drift  of  the  airplane.  In  addition,  the  bombardier  was  required  to  fire 
flexible  guns  and  cannon  and  to  make  minor  repairs  on  this  equipment. 
The  bombardier  was  also  required  to  navigate  by  dead  reckoning  with  a 
maximum  course  error  of  1^4°  and  a  maximum  ETA  error  of  1^4  minutes 
per  hour  of  flight 

Operational  training  programs  in  bombing,  while  they  varied  slightly  in 
detail  among  the  air  forces,  stressed  training  flights  which  established  the 
bombardier’s  proficiency  in  solving  the  bombing  problems  under  all  condi¬ 
tions  encountered  in  combat  operations,  including  daylight  and  darkness, 
high  and  medium  altitudes,  singly  or  in  formation,  and  long  and  short  ap¬ 
proaches.  Train  ng  schedules  required  the  bombardier  to  drop  demolition 
and  incendiary  bombs,  and  to  make  a  certain  number  of  releases  using  the 
pilot  direction  indicator, 

* 

Job  Specifications 

The  qualifications  essential  to  success  as  a  bombardier  were  investigated 

a  number  of  ways,  the  most  fruitful  of  which  were  interviews  with  train¬ 
ing  personnel  and  analyses  of  existing  rating  methods.  For  the  purpose  at 
hand,  Flying  Evaluation  Board  reports  (q.v.  under  criteria)  proved  re¬ 
latively  worthless.  Although  lists  of  desirable  characteristics  varied  some- 
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what  by  air  force  and  by  type  of  aircraft,  ma^y  of  the  discrepancies  either 
merely  reflected  differences  in  emphasis  or  were  purely  a  matter  of 
definition. 

In  the  Fourth  Air  Force,  job  specifications  of  B-24  bombardiers  woe 
investigated  principally  through  the  use  of  a  questionnaire.  Nine  items 
describing  particular  skfllx  and  personality  traits  were  developed  on  the 
basis  of  observations  during  training  flights,  examination  of  training  dirtc- 
tives,  and  informal  interviews  with  flight  instructors.  A  questionnaire 
composed  of  the  nine  items  was  administered  individually  to  nine  flight  in¬ 
structors  at  each  of  three  stations.  Instructors  were  asked  to  rank  the  items 
in  the  order  of  their  importance  to  successful  completion  of  Fourth  Air 
Force  training.  The  reliability  of  the  hierarchy  as  a  whole  was  estimated 
by  correlating  average  rank  assigned  by  odd-instructors  with  that  assigned 
by  even-instructors,  regarding  the  items  as  individuals.  Corrected  for  total 
number  of  ratings  by  the  Spearman-Brown  formula,  the  reliability  cod- 
ficiect  thus  obtained  was  .61. 

In  table  7.1  the  items  are  listed  in  the  order  of  the  average  rank  given 
them  by  the  instructors.  The  average  rank  and  standard  deviation  of  ranks 
given  are  shown  for  each  hem. 


Tabu  7.1.— Relative  importance  of  bombardier  trots  and  stSU 
BASED  ON  TKAIT  RANKINGS  AND  RATINGS  BY  FOURTH  AIR  FORCE  INSTRUCTORS 
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1.60 
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6.33 

1.5S 
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I 

7.17 

2.27 

• 

fi.5 

f 

7.33 

1.7* 

9 

_ i. 

The  standard  deviations  of  the  rankings  provide  a  convenient  means  of  f 
expressing  the  degree  of  agreement  among  the  instructors  as  to  the  relative  j 
rank  of  an  item.  From  the  data  in  table  7.1  it  is,  seen  that  instructors 
agreed  well  among  themselves  as  to  the  importance  or  lack  of  importance 
of  good  bombsight  procedure  and  .'bility  to  fly  on  C-l  autopilot.  On  the 
other  hand,  there  was  much  less  ;.greement  as  to  the  importance  of  per¬ 
formance  in  emergencies  and  abili’.y  to  get  along  with  the  crew.  Agreement 
on  the  other  items  was  somewhere  between  these  two  extremes.  If  the  items  : 
in  table  7.1  are  divided  into  skids  and  traits  or  attitudes,  the  relative  im-  I 
portance  of  the  items  becomes  more  meaningful.  Certain  technical  skills,  ; 
such  as  good  bombsight  procedi  re,  ability  to  identify  targets,  and  famili¬ 
arity  with  computers,  were  bel  'ved  of  paramount  importance  to  the  bom¬ 
bardier.  Certain  other  techroa!  skills  were  relatively  unimportant  to 
training  success.  Ability  to  fli  on  C-l  autopilot  was  thought  of  little  io-  , 
portance,  presumably  becaus:  accurate  bombing  was  possible,  although 

172 


jjjgkably  difficult,  without  its  use.  Evasive  action  was  disparaged  as  a 
natter  of  training  policy,  since  combat  requirements  in  evasive  action  varied 


5o  far  as  traits  and  attitudes  are  concerned,  motivation  (“eagerness”) 
foot  seems  to  have  been  considered  of  essential  importance.  Adequacy 
during  emergencies  was  some*. ha*  kv-  Important  than  for  airplane 
gjjjukrt  (see  chapter  41,  pr<dfcly  becau.e  bombardiers  were  lessdfefe 
quently  involved  in  major  em^ppncies.  Ability  to  get  along  with  WUP 
0tw  members  was  thought  no  more  significant  for  bombardiers  than  for 
aiiplane  commanders,  and  likeableness  was  similarly  regarded  a3  relatively 
unimportant. 

Ratings  on  these  nine  items,  together  with  ratings  of  over-all  proficiency, 
were  also  obtained  from  a  number  of  instructors  for  bombardiers  whom  they 
bad  checked  on  cioe  or  more  flights.  By  comparing  the  ratings  given  a 
bombardier  on  the  different  st«  r-rs  with  bis  over-all  rating  it  was  possible  to 
see  irhich  of  the  nine  traits  or  characteristics  entered  most  into  the  over¬ 
all  rating.  This  could  be  expressed  statistically  by  the  size  of  the  coefficient 
of  correlation  between  item  and  over-all  rating.  The  larger  the  *oe3dent, 
the  more  important  the  item  was  in  the  over-all  rating.  In  table  7.!,  in 
addition  to  the  order  of  rank  of  the  items  as  ranked  by  the  instructors, 
there  is  shown  the  relative  rank  of  each  item  in  order  of  the  degree  of 
correlation  between  ratings  of  bombardiers  on  the  item  and  over-all  ratings 
of  the  same  bombardiers.  It  can  be  seen  that  there  is  good  agreement  be¬ 
tween  the  instructors’  beliefs  as  to  the  importance  of  the  items  (expressed 
in  their  rankings  of  items)  and  the  unconscious  impo.tance  given  to  the 
traits  and  characteristics  in  their  ratings  of  bombardiers. 

Qualifications  regarded  by  instructors  as  desirable  in  B-29  bombardiers 
may  be  approximately  determined  from  a  rating  scale  used  at  the  Lead 
Crew  School,  Muroc  Army  Air  Field,  Fourth  Air  Force.  Table  7.2  shows 
the  differential  weights  assigned  to  the  14  items  in  the  scale.  It  wffl  be 
noted  that  training  personnel  responsible  for  the  scale  entirely  omi  ted 


personality  items. 

Job  specifications  for  the  B— 17  bombardier  in 
determined  principally  from  interviews  with  nam 


the  Third  Air  Force  were 
ing  personnel.  While  tech- 


Tabu-  *»  1. _ Item!  aid  argil*  for  bombardier  rating  scale 

LEAD  CREW  SCHOOL,  ML  ROC  A Ar.  FOURTH  AIR  FORCE 


Items  weighted  1  (J  items) 
Personal  equipment. 

Camera  equipment. 

Setting  and  pretiighting  altimeters. 

Items  weighted  J  ( 4  items) 
Bombardier’s  kit  and  target  .older. 
Bomb  racks,  fuses,  bomb  ba/  doors. 
Prefiight  of  bombsight,  auiopDot, 
signting  station. 

Ability  as  s  nV  r.bs/'rver. 


Hems  weighted  10  (7  items) 
Ar.iit}  in  using  compute1-!. 

Preset  u'.ta. 

of  target, 
g  procedure, 
procedure. 

fed 

Knowledge  ano  ^cution  of  standard 
bombing  prof’ 


Identifier.  ‘  ' 
Visual  bor’. 
R..dar  bom: 

..  ie-ic^ 
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aka)  skills  (e.g.f  smooth  bombsaght  procedure  and  accurate  target  ideatj. 
ficatioo)  were  regarded  as  highly  important,  instructors  assigned  cruejg 
significance  to  certain  personality  factors  in  discriminating  “good"  aaj 
“poor”  bombardiers.  These  included:  cooperative  attitude,  emotion 
stability,  common  sense  or  judgment,  and  motivation  and  initiative. 

As  with  other  aircrew  specialties,  study  of  the  reports  of  Flying  Eval*. 
tioo  Boards  did  not  yield  much  information  as  to  the  real  reasons  for 
failure  of  bombardiers  in  operational  training.  Usually  the  reports  permitted 
only  a  classification  of  reasons  for  re-evaluation  into  three  major  nfigDrio; 
personality  defect  (usually  fear  of  flying),  lack  of  proficiency  ar^  p^sied 
disability.  The  frequencies  with  which  these  categories  appeared  atfeasov 
for  Board  action  are  given  in  table  7.11  under  Criteria,  a  later  section  cf 
this  chapter. 

CRITERIA 

Average  Circular  Error 
Practice  Bomb**£ 

Average  circular  (radial)  error  lor  B-17  and  B~24  crews  was  obtained 
from  actual  practice-bomb  releases  over  targets  marked  on  the  grand, 
usually  in  the  form  of  with  concentric  rings  for  estimating 

of  the  hit  from  the  canter.  a  routine  matter  circular  error  scores  fffl 
approximately  standaraicaJOr  altitude  by  applying  empirically  determined 
corrections.  Hence,  the  corrected  scores  approximately  described  the 
circular  errors  which  would  have  resulted  had  the  bombing  been  done  at  a 
common  altitude  (12,000  feet).  The  resultant  scores  were  the  product  of 
many  factors.  Some  of  these  factors  reflected  the  true  bombing  proficiency 
of  crews.  Others,  however,  represented  extraneous  factors  which  were  h 
varying  degrees  uncontrolled.  The  latter  included  (jflftrences  in  bombing 
altitude,-  differences  in  illumination  and  associated  conditions  (day  v.  night 
bombing),  differences  in  scoring  procedures  (photographed  v.  Estimated 
strikes),  and  differences  in  bombing  procedure  (C-l  autopilot  v.  manotl 
releases).  Differences  between  and  night  bombing  were  actually  set 
so  crucial  as  might  have  been  expected.  For  one  sample  of  51  cases  is 
the  Second  Air  Force  the  mean  ACE  for  the  day  bombing  was  256  feet 
with  a  standard  deviation  of  60  feet  For  49  cases  of  the  same  sample  the 
mean  ACE  for  night  bombing  was  275  feet  with  a  standard  deviation  d 
90  feet.  Since  there  was  no  evidence  that  this  factor  seriously  attenuated 
the  reliability  of  average  circular  error,  no  attempt  was  made  to  correct 
circular  error  for  differences  attributable  to  this  factor.  Furthecoaore,  f* 
one  das*  of  41  Fourth  Air  Force  (Muroc)  bombardiers,  day  v.  night  circu¬ 
lar  error  correlated  0.43,  a  figure  which  compares  favorably  with  uncorrected 
reliability  coefficients  for  all  circular  error  scores  ^imputed  from  odd-evea 
missions. 

Circular  error  was  more  seriously  affected  by  the  method  of  scorinf 
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{wyloytJ.  Scores  determined  from  strike  photographs  were  usually  larger 
than  those  based  oo  bombardiers’  estimates.  Representative  distribution 
statistics  of  average  circular  error  for  both  methods  of  scoring  are  presented 
ja  table  7J.  Data  from  the  Second  Air  Force  tend  to  indicate  that  the 
inclusion  of  estimated  strikes  seriously  reduced  the  reliability  of  average 
oitukr  error  of  these  crews  was  .86  as  compared  with  a  coefficient  of  0.66 
graphing  all  of  their  strikes.  The  odd-even  mission  reliability  of  the  average 
circular  error  of  these  crews  was  .96  as  compared  with  a  coefficient  of  0.66 
for  the  total  class.  Furthermore,  among  the  6  classes  (280  students)  studied 
at  another  station  (Ardmore),  one  class  had  photographed  only  24  percent 
of  the  bomb  strikes.  The  odd-even  mission  reliabOi*y  of  average  circular 
error  for  this  class  was  only  0.25,  as  compared  with  a  coefficient  of  0.56 
for  the  total  group  of  6  classes  in  which  approximately  50  percent  of  the 
strikes  were  photographed.  However,  the  evidence  on  the  amount  of  error 


tuu  7J. — Corner: iso*  oj  overate  circular  error  for  photographed  and  estimated  strikes 
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introduced  by  combining  photographed  and  estimated  strikes  is  not  con¬ 
clusive.  since  the  samples  studied  were  small  and  the  influence  of  other 
factors  was  net  controlled.  In  any  case,  no  correction  was  applied  for  this 
factor  in  the  research  studies  of  average  circular  error. 

The  results  obtained  suggest  that,  although  the  bombardier  gave  himself 
the  benefit  of  the  doubt  when  he  estimated  his  circular  error,  either  his 
estimate  was  affected  by  what  he  knew  his  photographed  performances  were 
in  the  past,  or  else  he  did  not  completely  ignore  the  objective  facts  of  the 
performance  in  question. 

Differences  in  bombing  procedure  constituted  another  source  of  vari¬ 
ability  in  the  average  circular  error.  Bombing  done  with  C-l  autopilot,  with 
the  plane  being  flown  under  the  automatic  controls  was  distinctly  more  ac¬ 
curate  than  manual  bombing.  In  manual  bombing,  the  plane  was  flown 
with  the  pilot  manipulating  the  controls  on  the  bombing  run.  The  mean 
average  circular  error  for  **  class  of  51  Second  Air  Force  bombardiers  was 
248  feet  for  releases  under  automatic  control  and  293  feet  for  releases  under 
manual  control  with  standard  deviations  of  57  feet  and  62  feet  respectively. 
Since  from  60  to  95  percent  of  all  bombing  was  automatic,  no  correction  was 
employed  to  equate  for  differences  in  procedure  Failure  to  correct  for  these 
procedural  differences  was  believed  relatively  on  nportant  from  a  practical 
standpoint  in  studies  of  reliability.  Of  course,  f<  validation  purposes  cor- 
rertpd  c/'Aroe  Uai  a  Krt,->n  '  IIowcv  *t  ^  »'*  not  possible  to 

- — -V*  0VVI  VO  1TVU1U  UU  /  W  l/VVIl  t-r*  * 

obtain  samples  of  sufficient  size  to  permit  the  cak  dation  of  a  correction 
factor  in  which  any  confidence  could  be  placed. 
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The  over-all  reliability  of  average  circular  error  for  practice  bombing 
can  he  estimated  in  a  number  of  ways.  Table  7.4  lists  reliability  coefficient* 
obtained  from  various  methods  of  pairing  circular  error  data,  it  is  be- 
lieved  that  the  most  accurate  estimate  is  obtained  by  correlating  odd  and 
even  mission  scores.  Reliabilities  computed  from  odd  and  even  bomb  re¬ 
leases  are  spuriously  high  since  odd  and  even  releases  are  really  parts  of 
the  sane  performance.  The  variables  affecting  bombing  scores,  such  as  air. 
craft,  motivation,  weather,  etc.,  are  here  virtually  constant  Correlation  of 
scores  from  first  half  and  second  half  of  training  yielded  spuriously  loir 
coefficients  because  of  differences  in  type  of  mission,  training  directives, 
effects  of  learning  and  a  host  of  other  factors. 


Tablk  7 A. -  Reliability  coefuicnts  for  average  circular  error  he  practice  bombing 


‘Sine*  a  strictly  odd-even  pairing  of  midoas  coincided  witk  systematic  dUIereaccs  ia  type  ft 
■Moot,  a  random  choice  of  misdons  was  ased  la  pairing  senna. 

*  Only  Owen  missions  with  all  strikes  photographed  are  Included  ia  then  data. 


Although  the  reliability  coefficients  for  odd  and  even  missions  covered  a 
considerable  range,  practice  bombing  ACE  appears  to  have  had  from  low 
to  moderate  reliability. 

I 

Radar  Bombing 

In  general,  radar  bombing  in  the  Continental  Air  Forces  was  confined  to 
operational  training  for  B-29  crews.  Training  methods  were  designed  to 
offer  B-29  crews  realistic  practice  in  bombing  industrial  targets.  Major 
emphasis  was  placed  on  the  smooth  coordination  of  bombardier,  radar 
operator,  navigator,  and  airplane  commander.  Since  industrial  targets  were 
required  for  simulated  combat  training,  there  was  obviously  no  actual 
bombing  involved.  Instead,  scoring  was  accomplished  either  by  a  camera 
mounted  on  the  underside  of  the  fuselage  (the  more  usual  method)  or  by* 
ground  radar  installation  in  the  vicinity  of  the  target 
Several  methods  of  evaluating  radar  bombing  performance  were  used  in 
the  Second  Air  Force.  One  method  of  scoring,  referred  to  as  Photo  Score 
(Victorville),  required  a  series  of  photographs  at  specified  intervals.  The 
time  of  release  in  the  series  of  photos  was  known.  From  the  track  of  the 
airplane  and  other  data  such  as  altitude,  winds,  the  theoretical  point  of 
impact  was  estimated.  The  Photo  Score  (Nadir)  involved  taking  one 
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photograph  at  the  moment  of  simulated  release.  By  triangulatlon,  the  point 
immediately  below  the  plane  at  the  time  of  release  was  determined  ar>A 
from  this  information  plus  data  such  as  altitude,  winds,  speed  of  the  air¬ 
craft,  the  theoretical  point  of  impact  was  estimated.  The  third  scoring 
method  involved  the  use  of  ground  radar  installations.  These  :  retaliations 
were  able  to  tell  the  track,  altitude  and  all  other  necessary  Information  con¬ 
cerning  the  airplane  at  the  time  of  simulated  release  to  determine  the 
amount  of  error  in  the  bombing  performance.  There  are  relatively  few  data 
on  which  to  base  comparisons  of  the  three  types  of  scoring.  Reliability  co¬ 
efficients  for  odd-even  bomb  runs  were  0.10  for  the  first  photo  score  (N  of 
44),  0.S1  for  the  nadir  score  (N  of  140;  and  O.o9  for  tie  automatic  scor¬ 
ing  system  (N  of  51).  It  is  believed  that  the  ground  radar  method  of  scor¬ 
ing  is  potentially  the  most  successful  method. 

Since  each  of  the  three  scoring  systems  was  used  at  one  time  or  another 
with  the  crews  being  studied  it  was  not  possible  in  the  Second  Air  Force 


Table  7.5. — Reliability  o]  over-all  radar  terminal  CB  T-scores,  odd-even  missions 
16th  AND  17th  WINGS— SECOND  AIR  FORCE 
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‘Corrected  by  Spearmia-Brown  formula. 


to  get  a  large  body  of  data  in  which  just  one  method  was  used.  The  re¬ 
liability  coefficients  reported  in  table  7.5  v.’erc  obtained  as  follows:  First, 
the  average  score  for  each  crew  on  each  mission  was  converted  into  a 
T-score  based  upon  the  distribution  of  all  scores  at  the  same  station  of  the 
particular  type  involved.  Then  the  T-scores  for  all  three  types  of  odd  and 
even  mission  scores  were  averaged  to  obtain  over-all  odd  and  even  mission 
radar  terminal  CE  T-scores.  Cases  which  did  not  have  at  least  four  scores 
of  one  type  of  scoring  were  discarded.  Since  T-scores  were  determined  from 
separate  distributions  by  stations  for  each  type  of  scoring,  all  cases  from 
different  stations  were  combined  directly. 

All  radar  bombing  accomplished  at  the  Lead  Crew  School,  Muroc  Army 
Air  Field,  Fourth  Air  Force,  was  scored  by  camera.  Both  the  Victorville 
and  Nadir  scoring  procedure^  described  abo"c  were  used,  no  distinction  be¬ 
ing  made  in  the  analysis  of  results.  Reliability  coefficient  computed  from 
odd  and  even  missions  are  presented  :n  table  7.6.  Ihcs:  data  were  not 
corrected  for  altitude.  When  data  for  the  M »  class  were  corrected  to 
12,000  feet  the  reliability  coefficient  was  reduced  n  0.3<.  to  0.76. 

A  tendency  toward  bimodalit/  noticed  in  the  wfribu'tions  of  circular 
errors  for  the  first  class  at  Muroc  AAF  (approx  Mcly  v-0  oombing 
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scores)  suggested  to  research  personnel  the  possibility  that  there  were  two 
independent  factors  operating  in  the  radar  circular  error  scores.  One  of 
these  might  be  called  “gross  error/'  in  which  the  target  was  misidentified- 
and  the  second  was  “normal  aiming  error."  This  observation  led  to  further 
analysis  of  the  Muroc  data.  On  the  basis  of  the  distributions  of  the  first 
class,  it  was  decided  that  errors  of  6,000  feet  and  over  would  be  regarded 
as  gross  errors,  resulting  from  failure  to  identify  the  proper  target.  It  was 
hypothesized  that  these  errors  resulted  from  failure  on  the  part  of  those 
persons  with  radar  scopes  (radar  operator  and  navigator)  to  correctly 
interpret  the  blip  on  the  scope.  Errors  less  than  6,000  feet  were  believed 
to  be  largely  influenced  by  the  skill  of  the  bombardiers  in  synchronizing 
the  sight  and  introducing  iinal  corrections. 

The  reliability  of  normal  aiming  errors  was  estimated  from  odd-even 
mission  scores.  Data  from  gross  errors  were  treated  as  percentages  of  the 


Tails  7.6. — Odd-even  mission  reliability  coefficients  for  measures  of 
radar  bombing  profkkncy 
MUROC  AAF,  FOURTH  AIR  FORCE 
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total  runs  for  odd  and  even  missions,  since  the  actual  magnitude  of  gross 
errors  was  irrelevant.  These  reliability  coefficients  are  also  presented  in 
table  7.6.  These  two  scores,  ACE  of  normal  aiming  and  percentage  of  gross 
errors,  were  correlated  0.10,  0.41  and  0.45  for  the  June,  July  and  August 
classes.  This  degree  of  correlation  must  be  regarded  as  moderate,  consider¬ 
ing  the  reliabilities  of  each.  Comparison  of  the  reliability  coefficients  of 
the  various  scores  suggests  that  the  presence  of  gross  errors  in  total  circular 
error  did  not  significantly  reduce  the  reliability  of  the  raw  scores  This 
indication  that  the  two  factors  were  not  as  independent  as  at  first  thought 
was  substantiated  by  data  from  subsequent  classes.  Distributions  of  these 
later  data  did  not  show  bimodality  and  were  very  nearly  normal  except 
for  a  long  tail  of  extremely  high  error  scores.  This  long  tail  of  large  error 
scores  is  probably  a  function  of  the  bombing  situation  in  which  there  » 
virtually  no  limit  to  the  extent  by  which  a  target  can  be  missed. 

While  the  distinction  between  normal  aiming  and  gross  errors  uM  not 
provide  a  great  deal  of  insight  into  the  nature  of  the  function,  the  results* 
analysis  demonstrated  that  the  gross  error  score  was  moderately  reliable. 
This  result  is  of  practical  value  since  it  involves  far  less  computation  than 
does  the  usual  average  circular  error  score. 

From  the  standpoint  of  reliability,  radar  average  circular  error  scores  are 
regarded  as  useful  criterion  measures. 
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Rfing » 

Rating  scales  for  bombardiers  were  used  extensively  throughout  the 
Continental  Air  Forces.  In  most  cases,  however,  the  amount  of  tfay*  re* 
quircd  to  develop  rating  methods  precluded  a  thorough  follow-up  of  their 
effectiveness.  The  succeeding  paragraphs  briefly  describe  a  number  of 
representative  rating  methods. 

Efficiency  ratings  from  Form  66-2  were  available  throughout  the  Con¬ 
tinental  Air  Forces.  These  were  ratings  on  a  5-point  scale  which  were  as¬ 
signed  at  3-  month  intervals  by  supervisory  personnel.  Since  a  single  rating 
was  submitted  for  each  rating  period,  no  direct  estimate  of  the  reliability 
of  this  measure  could  be  made.  However,  at  one  station  b  the  Second  Air 
Force  the  reliability  coefficient  computed  tram  pairs  of  juccesslvs  ratings 
one  month  apart  was  0.37  for  109  bombardiers. 

An  instructors’  questionnaire  for  bombardier  trainees  was  developed  foe 
use  b  the  Third  Air  Force.  The  six  items  in  the  scale  were:  cooperative 
attitude,  emotional  stability,  common  sense,,  over-all  bombardier  proficiency, 
motivation  and  initiative,  and  desire  to  serve  with  trabee  in  combat  To 
minimize  halo  effect  a  non-numerical  descriptive  ratbg  technique  was 
employed.  Neither  item  nor  total  scale  reliabilities  were  comput’d. 

A  preliminary  ratbg  scale  was  used  in  the  Fourth  Air  Force  ior  the 
evaluation  of  R-24  bombardiers  at  three  bases:  Muroc,  Walla  Walla  and 
March  Field.  The  scale  consisted  cf  ten  questions  b  response  to  which 
instructors  were  requested  to  rate  (half  above-average,  half  below-average) 
all  of  the  students  whom  they  had  check-ridden.  Except  for  the  bclusion 
of  an  over-all  anchor  Hem,  the  questions  referred  to  the  same  traits  as  did 
the  ranked  items  listed  in  table  7.1.  in  order  to  minimize  halo  effect  the 
questions  were  admbistered  successively  on  separate  sheets  of  paper,  on 
which  were  typed  the  names  of  all  students  in  the  section.  Sbce  adequate 
samples  of  bombardiers  rated  more  than  once  were  not  available,  no  esti¬ 
mate  of  item  reliabilities  was  made. 

B-29  bombardiers  at  the  Lead  Crew  School,  Muroc  Army  Air  Field, 
Fourth  Air  Force  were  evaluated  by  a  mission  rating  system  (see  table 
7.2  for  the  scale  items  and  weights).  On  every  mission  for  which  a  bom¬ 
bardier  instructor  was  aboard,  students  were  rated  on  a  5-pobt  scale  on 
each  of  the  14  items.  In  addition,  the  instructors  were  required  to  make  an 
over-all  evaluation  of  the  bombardier  as  a  potential  lead  crew  member. 
The  odd-even  reliabilities  of  the  average  store  (the  average  of  the  ratrngs 
on  the  14  items)  and  the  over-a’i  score  art  presented  in  table  7.7.  Both 
scores  show  moderate  reliability  and  ate  quite  highly  intercorrelated  (0.70 
on  a  sample  of  94). 

Two  types  of  descriptive  rating  scales  were  use  a  the  Second  Air  Force 
for  evaluating  B-29  bombardiers.  The  traits  for  'ich  items  were  con¬ 
structed  were  obtained  from  interviews  with  combat  personnel,  from  man¬ 
uals  and  directives  for  selection  and  training  of  d  crews,  and  from 
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iateffigeace  reports  and  tarioa  la^.so.  Scale  A  mas  adm:  ■ester  ed  at  la« 
stations:  Oorts,  Ahaagoria,  Tocsco  aad  Biggs;  and  Scale  B  mas  ad¬ 
ministered  at  another  fcwr  stalkes:  Albuquerque,  Pj^te,  Walker  and  Great 
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fa  addhkm  to  tbe  fcrtgaaf  soles,  i  variety  of  local  mis*  devices,  too 
ssisooas  to  describe,  were  axtxsit red  it  vzrsxa  trairirf  stations 
[jfxjbccl  tbe  cocstxy.  TV  sittw  iky  !co,  ikyf  were  tssiSy  orf  kt 
xrcssfeses ts  desl^ced  to  sett  special  administntbe  nqdnoenti  Tbe 
oadeqcate  cfispcrsko  of  nticjs  cssaHy  obtained  mode 
0C  laese  procedures  sot  worth  while. 

CnMtwd  Trainer  Grade* 

Asoeg  groand  trainers  for  which  adequate  iefoesatica  was  available, 
cssr  tbe  7-A-3(A-5)  trainer  was  designed  strictly  for  bocba^Ten.  Tbe 
7-A-3  trainer  coexisted  essentially  of  a  sirrai-ied  hosbarotr’s  rnrrparfme^ 
of  i  R-17  cr  3-24.  Eqopoest  iachaded  a  Nccdtn  baabdgbt,  pilot  direc- 
fV-r.  ledxaloe,  autocaatic  bosrbiag  coc-pcter,  C2  and  E6B  computers,  and 
ganrjiomrtg.  A  projector  naomied  near  the  top  cf  tbe  trainer  boosing 
projected  i  moving  panoramic  terrain  cn  a  screen  beneath  the  bcenbardier’s 
eocpar'.sjeat,  so  that  actual  eight  was  rathe?  dosdy  simulated.  The 
tr?wr  was  so  designed  that  a  number  o i  objective  score  wee  readily 
avaiiab'e.  Of  these  scores  circular  error  alone  was  isvestigat  Odd-even 
r^gyfl  reliabilities  computed  for  samples  frcca  three  air  forces  arc  reported 
is  table  7.10. 


T ir  y  7.10 — Rdssbdhj  cexjtdexis  for  7-A-I  tracer  sr as*g  amder  arm. 
rZrrKCl'd  front  (crrdcliexs  Ixtseox  odd  cxd  «-<*  K=iw 
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Score 5  from  navigation  and  gunnery  trainers  were  available  at  most  sta¬ 
tions.  The  dead-reckoning  (G-l  navigation)  trainer  yielded  an  odd-even 
mission  reliability  oi  0.47  for  542  bombardiers  at  one  station  in  the  Second 
Air  Force.  On  the  Jam  Handy  gunnery  trainer  the  reliability  coefficient 
obtained  from  the  average  intercorre!at:on  of  3  scores  (adjusted  by  the 
Spearman-Brown  formula)  was  0.41  f  a  77  accord  Air  Force  bombardiers. 


Academic  Grade.- 

Academic  grades  fi*>m  written  tests  and  class  room  performance  were 
available  throughout  the  Contiacmr-'  A::  -  ^rce.  ine  tests  notable 
mainly  for  their  lack  of  uri-fornut}  in  content  d  constru't.  m.  :rca.  station 
to  station.  Most  frequently  encountered  were  "‘.s  c-- wring  equipment, 
Gl  autopilot,  thecr>'  cf  bombing,  gunnery  ar.-.  *  mmunications.  In  the 
Second  Air  Force  reliab.lity  ce  :  c  estimate  m  on  the  first 
a-td  second  half  of  training  v.ere  0.75  \j:  gunnery  ades  (N  cf  27),  0.55 
■cr  bombardment  (N  of  ICSj,  and  C4:  tor  com;  ucatic-ns  grades  (N 
of  54). 
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Fljiif  Evaluation  Borri  Adba 

The  principal  function  of  Flying  Evaluation  Boards  (FEB’s)  was  it 
investigate  and  appraise  aircrew  officers  who  bad  refused  to  fly  or  wfco 
were  charged  with  some  type  of  incompetence.  The  major  difficulty  en¬ 
countered  In  interpreting  FEB  decisions  as  potential  criteria  was  the  1 Mk 
of  standardization  in  methods  of  investigation  and  evaluation.  Table  7.H 
presents  the  frequencies  with  which  various  categories  of  reasons  were  nyj 
as  principal  cause  for  board  action,  for  samples  of  evaluated  bombardiers 
from  the  Second,  Third  and  Fourth  Air  Forces. 

Tuu  7JL— f'tiwemda  *f  fnmeipti  rtmeoms  for  referrai  of  bomlmdien 
If  Flym*  Erobm* f rr  Boards 
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Of  the  interconelatioos  shown  in  table  7.12  among  the  criteria  available 
for  B-24  bombardiers  in  the  Fourth  Air  Force  only  one,  between  G-l 
trainer  rating  and  average  academic  grade  is  significant  at  the  one  precrat 
leveL  Since  at  least  some  of  the  measures  are  known  to  have  had  mniWfif 


Tuts  7.12. — InUrcomlations  omo*g  measures  of  frofuieacy  of  bomborSen  (B-2f) 

I“HX  EE  FOCKTH  MX  VCftCZ  BASES 


r*»driiKT  mtmmrm 

t 

2 

*  , 

* 

S 

•.IS 

10 

•lB 

14* 

143 

144 

2S1 

JM 

mm 

4  A - j-  1  ‘  p^jb 

2S1 

41 

«  n.i  ^  rr*^g 

41 

41 

41 

Kfn-Kabn  of  cm  appear  bcb»  (Sc  -fray  1 1  S<=a  of  nicBrirett  km  Beam  * 

btiritl  yaittit  amdtiioa  of  good  prrlnr— ca, 


reliabilities  some  independence  of  skills  represented  in  the  saxes  can  be 
presumed. 

As  has  been  stated  earlier,  the  2  rating  scores  for  B-29  bombardiers  at 
the  Lead  Crew  School  correlated  C.70  with  each  other  for  a  sample  of  94 
cases.  As  shown  in  table  7.13  the  rating  sects  showed  little  relationship 
to  the  bombing  scores. 

Tail*  7.13 .—Intercorreiolions  ar»on[  criteria  available  for  B-29  bombardiers 
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lack  of  relationship  between  radar  error  scores  2nd  ratings  b  coo- 
frayed  by  the  data  from  the  Second  Air  Force.  In  the  case  of  125 
oscs  with  Scale  A,  the  correlation  between  the  radar  scores  and  ratings  was 
0.13  while  for  Scale  B  on  86  cases  the  coefficient  was  zero.  wo-wever,  is 
jie  case  of  B-17  bombardiers  the  relationship  between  pra^uas  bombing 
jverage  circular  error  scores  and  ratings  was  considerably  M§fa*r  as  the 
j^olts  in  tabic  7.14  indicate.  That  this  relationship  is  not  dye  sekfy  to 
differences  in  aircraft  is  attested  by  the  correlation  of  0.58  Rating 

A  total  scores  and  practice  boshing  ACE  for  160  B~lv  l^shardiea. 
The  higber  relationship  in  the  case  ci  ditular  errors  for  practice  boobs 
is  doe  in  part  *°  the  fact  that  the  raters  were  more  likely  to  know  the 
pyytW  bf*"htng  score.  Among  the  raters  utilized  in  these  studies  the  flight 


Tjgiz  7.14- — Co*rdaiiW  b&xeen  cversge  drcicar  error  (Jmciice  b+mbi* f) 
s*d  vcri&vj  reibig  tcorts 

B_i7  and  b-24  bom basldibxs— second  am.  roves 


sargeno  alone  was  unaware  of  the  bombardier’s  average  circular  error  and 
this  coefficient  was  markedly  lower  than  the  others.  The  radar  bombing 
score  was  much  less  likely  to  be  known  to  the  raters  for  a  number  of  rea- 
23ns.  No  record  of  radar  scores  was  available  to  the  raters  at  the  time  the 
ratings  were  made.  la  addition,  the  radar  score  was  not  usually  regarded 
as  solely  a  measure  of  bombardier  pronciency,  being  more  often  regarded 
as  a  reflection  of  the  bombing  skill  oi  several  members  of  the  crew.  Thus, 
even  if  raters  knew  the  radar  bombing  score,  it  was  not  as  likely  to  affect 
the  rating  as  knowledge  of  the  average  circular  error  of  practice  _  mg- 
A  low  but  statistically  significant  correlation  between  average  ground 
school  grades  and  both  radar  and  practice  bombing  scores  was  oun  or 
B-29  bombardiers  in  the  Second  Air  Force.  Both  coefficients  were  bisenals 
between  ACE  and  ‘  high-low’  classification  on  the  basis  of  the  a'erage  o 
all  ground  school  grades.  The  coefficient  was  0.21  in  both  casK  on  a  sample 
cf  159  students  for  practice  bombing  and  124  for  radar  bombing.  0 
efficients  are  significant  at  toe  5  wren.  bee!.  However,  practice  .embmg 
ACE  showed  no  relationship  to  ground  scbc.l  average  c-c-  t  a‘  ^ 
fit  the  case  of  112  B-17  bombardiers,  as  is  ■«»  Ur  tr.e  results  »  table 

^Rating  scale  -cores  for  Sca'e  A  c  related  0.1.  lb  round school  grade, 
for  a  sampie  of  160  B-29  bombardiers.  This  btse  .al  correlation  coeftae  t, 
computed  as  described  for  bombing  scores  abov  -  sign.. icon  a 
percent  level. 
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In  the  Third  Air  Force,  the  bombardier  questionnaire  score,  described 
earlier,  correlated  0.83  with  the  rankings  of  130  bombardiers  by  the  saa* 
instructors  making  t\e  entries  on  the  questionnaire. 

In  general,  the  degree  of  correlation  observed  between  different  criteria 
suggests  tentatively  that:  (!)  Rating  scores  of  various  sorts  had  little  or 
nothing  in  common  with  radar  bombing  scores,  (2)  rating  scores  were 
moderately  related  to  practice  bombing  scores,  (3)  bombing  scores  of  boU 
types  appeared  to  have  some  slight  correlation  with  ground  school  per¬ 
formance  and  finally,  (4)  rating  scores  did  not  show  any  such  relationship. 


Tau  Correlations  betveem  no age  drctiar  error  (fnctk*  bombimg) 
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Evaluation  of  Criteria 

Evaluated  in  terms  of  their  reliability,  practicability  and  apparent  rele¬ 
vancy  to  the  ultimate  bombardier  criterion,  the  criteria  described  in  the 
foregoing  paragraphs  appear  to  be  promising.  As  a  ~vhole  they  cover  pretty 
well  the  principal  duties  of  the  bombardier  in  operational  training.  Their 
reliabilities,  although  far  from  high,  are  satisfactory  minimum  values.  They, 
create  few  major  administrative  problems  in  use,  and  they  are  available 
throughout  the  Continental  Air  Forces.  However,  in  each  case  there  are 
certain  serious  objections  to  their  use  as  criteria  of  bombardier  proficiency. 

Average  Circular  Error 

The  average  bombing  error  is  in  many  ways  the  most  impressrv;-  criterion 
available  It  has  an  inherent  validity  not  possessed  by  any  ether  easure 
of  crew  effectiveness.  However,  its  full  value  has  often  been  reduces  ev  i 
number  of  factors.  The  most  serious  difficulty  met  in  using  average  circus 
error  as  a  criterion  of  bombardier  proficiency  in  operational  training  was 
the  fact  that  it  was  probably  influenced  nearly  as  much  by  pDot  proficiency 
as  by  bombardier  proficiency.  In  this  sense,  average  circular  error  may  be 
more  a  measure  of  crew  proficiency  than  a  measure  of  proficiency  of  any 
one  crew  member.  In  fact,  it  is  likely  that  the  fact  that  the  same  pilot  and 
crew  fly  with  the  bombardier  on  his  bombing  missions  is  responsible  foe 
the  higher  degree  of  reliability  found  for  avenge  circular  error  in  opera¬ 
tional  training  as  compared  with  average  circular  erro  in  Bombardier 
Schools  in  thr  AAF  Training  Command.  In  the  Inter  case  the  differences 
in  pilot  proficiency  tended  to  reduce  the  reliabilit/  of  circular  error  scored 
since  different  pilots  flew  with  a  bomi-rdier  on  different  missions.. 
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One  of  the  major  sources  of  distortion  of  average  circular  error  has  bee* 
ckrical  iceffideacy.  At  one  station  in  the  TL-d  Air  Force  approximately 
70  percent  of  the  bombing  records  inspected  contained  clerical  errors. 
Errors  were  found  consistently  in  such  operations  as  the  recording  of 
altitude,  range  direction,  and  raw  circular  error,  n  the  conversion  of  nor 
error  to  12,000  feet,  in  the  product  of  the  number  of  bombs  dropped  and 
converted  circular  error,  and  in  the  cumulating  of  converted  circular  error. 

Another  important  source  of  distortion  was  the  treatment  of  gross  errors. 
In  practice  bombing,  bombs  dropped  off  the  range  were  neither  sawed  nor 
recorded.  However,  if  a  oombardier  could  (or  cared  to)  istimate  such  a* 
error,  his  estimate  was  recorded.  In  radar  bombing,  whta  <mrmg  was 
accomplished  by  camera,  “strikes”  which  could  not  be  identified  on  a  master 
photograph  cf  the  target  were  ignored  even  when  they  obviously  represented 
gross  errors.  Thus,  a  great  majority  of  the  strikes  reported  as  "unicorable” 
were  probably  very  iarge  errors,  for  which  no  record  was  available,  cod  an 
important  segment  of  the  data  was  overlooked.  Should  further  analysis 
establish  that  “percentage  of  gross  errors’’  is  satisfactorily  reliable,  it  might 
be  reasonable  to  record  that  datum  tn  addition  to  ACE  and  to  analyze 
bombing  error  routinely  in  terms  of  Loth  scores.  Normal  aiming  errors  in 
that  case  would  be  treated  as  magnitudes,  and  gross  errors  as  relative 
frecoencks. 

Jn  addition  to  the  above-named  factors,  many  other  distorting  inflnpnry* 
can  be  cited.  Many  of  these  are  so  apparent  that  comment  is  unnecessary. 
Standardization  of  training  requirements  f*om  trainee  to  trainee  would  do 
much  toward  eliminating  a  host  of  factors  which  attenuate  the  reliability 
of  circular  error.  Improved  scoring  procedures,  such  as  sonic  recording  of 
practice  bombing  errors  and  ground  radar  scoring  for  radar  bombing,  will 
doubtless  reduce  other  important  sources  of  error. 

Rttmgs 

Insufficient  evidence  makes  it  extremely  difficult  to  evaluate  the  rating 
scales  described  above.  For  example,  it  is  not  now  possible  to  decide  vrith 
the  evidence  at  hand  whether  the  Second  Air  Force  descriptive  scales,  which 
are  administered  at  the  end  of  training,  were  more  or  less  efficient  than  the 
less  refined  Muroc  scale  which  was  administered  mission-by-mis:  ion.  On 
the  whole,  the  rating  devices  appear  to  have  had  moderate  xeliabil  ty,  and 
their  designs  appear  to  encompass  adequately  the  breadth  of  tht  bom¬ 
bardier’s  essentia]  skills  and  personality  trait:  Improvement  of  results  with 
such  scales  probablv  rests  as  much  on  the  fut  *e  indoctrination  of  instruc¬ 
tors  in  good  rating  practices  as  on  refinements  n  the  r  ah  3  tnemselves. 
However,  the  chief  objection  to  fbe  use  of  ratings  ^  their  inherent  suscep¬ 
tibility  to  subjective  errors.  The  moderate  degree  i  reliability  obtained 
"•ay  be  largely  a  reflection  of  group  consistency  of  pi  udic-s  or  oi  common 
reputation,  rather  than  a  reflection  of  agreement  in  dependent  observa* 
5  ions. 
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Ground  TrthUi  Scares 

CkricaJ  errors  and  imperfect  standardization  of  content  and  procedure 
of  administration  constituted  the  principal  sources  of  attenuation  in  grtrai 
trainer  scores.  It  is  also  likely  that  an  increase  in  the  amount  of  time  al¬ 
lotted  to  ground  trainer  instruction  would  yield  better  data.  ^ 

these  shortcomings  are  remediable,  it  should  be  possible  to  obtain  scans 
that  are  objective  as  weS  as  reliable. 

Academic  grades  suffered  from  a  variety  of  difficulties.  Inexpert  construc¬ 
tion  of  tests,  constant  modification  to  indude  technical  innovations,  ». 
adequate  standardization,  clerical  errors,  and  poorly  motivated  students 
all  combined  to  make  them  relatively  meaningless.  A  number  of  remedies 
are  obvious  and  practicable.  Perhaps  the  dearest  need  here  is  for  a 
test-construction  agency  whose  responsibility  would  be  the  design  and  esn- 
tinual  modification  of  a  series  of  standard  tests. 

Flying  Evaluation  Board  Reports 

Re-evaluation  of  bombardiers  by  action  of  Flying  Evaluation  Boards  did 
Dot  occur  sufficiently  often  for  this  type  of  criterion  to  be  of  much  practical 
value  in  validation  studies. 

The  use  of  Flying  Evaluation  Board  records  for  validation  purposes  also 
appeared  to  suffer  from  lack  of  standardization.  Uniform  procedures,  urn- 
form  rules  of  evidence  and  experienced  board  members  who  are  fully 
grounded  in  the  rules  and  procedures  are  essential  requirements,  if  tk 
board  decisions  are  to  become  a  satisfactory  criterion. 

VALIDATION  STUDIES 
Average  Circular  Error 
Practi  t  Bombing 

With  average  circular  error  as  the  criterion,  validity  coefficients  for 
stanines  were  computed  for  437  B-17  bombardiers  in  the  Second  Air 
Force.  The  results  of  this  computation  presented  in  table  7.16  indicate  tint 
the  relationship  between  the  bombardier  stanine  and  circular  error  was  not 
statistically  different  from  zero.  * 


Ta*le  7.16. — Validities  of  the  bombardier  stanine  for  average  circular  error 
B-17  KKD  B-24  BOMBARDIERS — SECOND  AIR  TOBCB 
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The  validity  coefficients  for  the  stanines  ior  70  B-29  bombardiers  in  tbr 
Second  Air  Force  and  84  B-29  bombardiers  at  Muroc  in  the  Fourth  Af 
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Fort*  arc  presented  in  table  7.17.  The  coefficients  given  In  the  table  rep* 
stsent  averages  (by  Fisher's  a)  of  separate  coefficients  for  each  class  and 
<tlli0n  As  was  the  case  with  practice  ACE,  the  stanines  of  bombardiers 
were  oot  significantly  related  to  ary  of  the  radar  bombing  scores. 

<jn—w  7J7 — Conditions  Ww«  Xcnixt,  *f  bomber dien  end  rodor  kembimf  sun* 
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Table  7.18  shows  the  bombardier  ctanine  validity  coefficients  obtained  for 
varices  hinds  of  ratings  of  B-17  bombardiers  in  the  Second  Air  Force. 
Noae  of  the  coefficients  is  statistically  significant  except  that  obtained  for 
surgeon’s  rating,  which  is  negative,  and  crew  rating  which  is  positive. 
The  <™*n  samples  make  these  latter  results  of  doubtful  importance.  De¬ 
scriptions  of  the  different  ratings  used  are  given  in  an  earlier  section  under 

Often*. 

7ahx  7.18. _ Validities  of  bombardier  stanm:  for  various  types  of  nti*t* 

B-17  AND  B-24  BOMBARDIERS— SECOKD  AIR  FORCE _ 
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In  table  7.19  are  presented  validity  coefficients  for  the  three  stanines  of 
B-29  bombardiers  in  the  Second  and  Fourth  Air  Forces,  using  rating  scale 
scores  as  criteria.  These  scales  are  described  earlier  in  the  chapter.  None 
of  the  coefficients  is  significantly  different  from  zero. 

In  the  Third  Air  Force,  the  bombardier,  ruvigator  and  pilot I  stanines  of 
13J  h-29  bombardier!  correlated  0.02  -0.11.  red  -0.C!  nnth  ratings  on 
the  bombardier  questionnaire  described  under  c.t  'crii  a  \e. 

Ground  Trainer  Grade# 

Two  studies  were  conducted  to  determine  the  stent  m_  which  the 
stanines  of  bombardiers  predicted  their  pcriormanc  n  th-  -A-3  bomD 


187 


trainer.  In  the  Second  Air  Force  (Great  Bend),  the  correlation  coeffide#, 
between  7-A-3  circular  error  and  the  bombardier  and  navigator  stanhes  (9 
32  B-29  bombardiers  were  —0.02  and  0.16  respectively.  The  predictive  ef. 
fidency  for  trainer  performance  is  somewhat  greater  in  the  results  from  d* 
Third  Air  Force.  The  validity  coefficients  were  0.13  for  the  bombardier 
0.23  for  the  navigator  and  0.01  for  the  pilot  stanine  on  a  sample  of  4) 
bombardiers  at  Barksdale  Field.  None  of  these  coefficients  is  significant  at 
the  5  percent  leveL 


Ta*lx  7J9 .—Correlations  hlw»  instructor?  rulings  uni  stanbus  of  bembor&tn 
B-29  BOMBARDIERS,  SECOND  AND  FOURTH  AU  FORCES 
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Academic  Grades 

Table  7.20  shows  the  bombardier  stanine  validity  coefficients  for  various 
types  of  academic  grades  and  ground  training  criteria.  Attention  is  called 
to  the  fact  that  the  bombardier  stanine  is  significantly  related  to  three  of 
these  measures:  academic  average,  ground  school  average,  and  bombardier 
entrance  test 

Tabu  7  JO. — Validities  of  the  bombardier  stanine  for  ground  trainer  criteria 


B-17.  3-24  AND  B— 29  BOMBARDIERS — SECOND  AIR  FORCE 
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In  the  16th  Wing  of  the  Second  Air  Force,  the  B-29  bombardiers  of  five 
classes  were  divided  into  “upper”  and  “lower”  groups  on  the  basis  of  their 
average  ground  school  grades.  TLe  biserial  correlation  between  the  bom¬ 
bardier  stanines  and  this  classification  are  presented  in  table  7.21. 

These  results  are  quite  different  from  those  obtained  with  B-17  and 
bombardiers.  Whether  this  is  brought  about  by  the  fact  that  B-29  trainini 
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ms  newer  and  less  well  standardized  or  whether  other  (actors  are  respon¬ 
sible  is  not  known. 

fuu  }2\/—BiS€rUL  correlations  btlvetn  bombardier  iltnhus  and  pound  school  podas 
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Flying  Evaluation  Board  Report* 

In  an  effort  to  predict  elimination  of  bombardiers  by  Second  Air  Force 
Flyjng  Evaluation  Boards,  the  bombardier  stanines  of  123  bombardiers  re¬ 
lieved  from  flying  duties  by  FEB’s  were  compared  with  those  of  123  bom¬ 
bardiers  who  (1)  were  never  referred  to  FEB’s,  (2)  were  in  operational 
training  at  the  time  of  FEB  action  and  (3)  were  tested  at  a  classificat? 
center  at  approximately  the  same  time  as  the  eliminated  bombardiers.  The 
results,  which  appear  in  table  7.22,  indicate  that  the  stanines  of  bombardiers 
eliminated  by  FEB  action  are  significantly  lower  than  those  of  a  randomly 
selected  control  group.  The  stanines  of  15  Third  Air  Force  bombardiers 
who  were  eliminated  by  FEB  action  were  slightly  (but  not  significantly) 
higher  than  those  of  a  control  group  of  the  same  size. 


Table  1 22.— Bombardier  ztamnes  of  bombardier  FEB  elimbiees  compared  with 
those  of  control  samples  of  non-eltminees 

B-17  AND  B-24  BOMBARDIERS— SECOND  AND  THIRD  AIR  FORCES _ 
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SUMMARY 

Most  of  the  time  spent  in  research  on  bombardier  training  was  spent  in 
the  discovery  and  evaluation  of  measures  of  proficiency.  Bombing  scores, 
trainer  grades,  ratings,  rating  scale  scores  and  academic  grades  were  rather 
thoroughly  explored.  With  the  exception  of  routine  ratings  and  academic 
grades,  all  of  these  were  found  to  have  a  degree  of  reliability  which,  though 
low,  was  si  ficient  for  their  use  as  proficiency  c  ‘eria.  Because  of  suscep¬ 
tibility  to  subjective  errors,  rating  scale  scores  re  not  consider  very 
useful  criteria  in  themselves.  Ground  trainer  graces  were  based  on  proce¬ 
dures  which  varied  too  much  from  one  station  to  nother.  The  measure 
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that  has  the  highest  inherent  validity,  the  bombing  score,  did  not,  in  acted 
practice,  sufficiently  reflect  the  prowess  of  the  bombardier  to  be  complete^ 
satisfactory.  Thus,  no  one  measure  was  found  which  could  be  consHaeJ 
a  completely  satisfactory  criterion  of  bombardier  proficiency. 

The  of  the  bombardiers  in  the  samples  studied  showed  little  « 

no  correlation  with  most  of  the  criteria  studied.  There  b  evidence  that  the 
bombardier  stanine  had  some  relationship  to  certain  measures  of  proficiency 
in  academic  subjects.  The  general  inadequacy  of  the  available  criteria 
this  lack  of  predictive  efficiency  on  the  part  of  the  bomban&r 
stanine  difficult  to  interpret  It  b  believed  that  effective  validation  of  any 
device  for  prediction  of  bombardier  proficiency  in  operational  training  wfll 
have  to  wait  upon  the  development  of  measures  of  bombardier  proficiency 
that  are  more  adequate  than  any  tried  so  far. 


CHAPTER  EIGHT - - - 

Flight  Engineer 


analysis  of  duties  and  specifications 

Job  Analy*!* 

Tbe  flight  engineer  was  a  relative  newcomer  among  the  officers  of  the 
aircrew.  The  job,  of  course,  was  in  existence  for  some  time  before  the  post* 
tion  was  formally  recognized.  It  had  its  beginnings  in  the  division  of  labor 
among  enlisted  crew  members  of  early  two  and  four  engine  aircraft  One 
aew  member  was  charged  with  responsibility  for  certain  preflight  Inspec- 
tions  of  engines  and  for  supervision  of  the  fuel  and  o3  systems.  With  the 
increasing  complexity  of  bombardment  aircraft  the  importance  of  the  flight 
yngin^r  increased  enormously.  Not  only  was  importance  increased,  but  the 
duties  became  correspondingly  difficult  and  complex,  until  in  the  heavy 
bombardment  crew,  the  necessary  skills  and  knowledge  required  organized 
courses  in  special  schools.  With  the  advent  of  the  B-29  aircraft,  training 
Wain*  stfli  more  extended  and  included  the  additional  step  of  transition 
training  of  airplane  commander,  copilot  and  flight  engineer  as  a  team  prior 
to  operational  training  of  the  total  crew.  At  this  point,  the  flight  engineer 
was  made  a  commissioned  officer  on  a  par  with  copilot,  navigator  and  bom¬ 
bardier.  #  : 

For  a  number  of  reasons  no  detailed  analysis  of  the  duties  of  the  flight 
engineer  was  carried  out  in  the  Continental  Air  Forces.  Training  in  the 
basic  skills  and  routine  handling  of  the  job  is  done  in  the  AAF  Training 
Command  so  that  such  studies  can  probably  best  be  accomplished  there. 
Then  too,  a  Psychological  Research  Project  was  set  up  in  connection  with 
that  training  with  specific  responsibility  for  developing  selection  procedures 
and  methods  of  evaluating  flight  engineer  proficiency.  Effort  in  the  Con¬ 
tinental  Air  Forces  was  therefore  concentrated  upon  studies  of  those  aspects 
of  the  job  that  were  peculiar  to  operational  training  and  those  especially  im¬ 
portant  in  the  effective  performance  of  the  whole  crew.  .  • 

In  operational  training,  the  flight  engineer  learned  to  apply  his  knowledge 
of  cruise  control,  of  fuel  consumption,  and  of  all  systems  of  the  aircraft 
to  practical  problems  in  simulated  combat  operations.  He  had  to  become 
so  familiar  with  the  power  plant,  mechanical  and  electrical  systems  of  his 
plane  that  this  knowledge  was  almost  second  nature  to  baa.  He  needed  to 
bow  the  location  of  all  tools  and  emergent  *  equipment  and  be  able  to 
make  minor  repairs  in  flight.  In  B-29  crews  t  .pedal)) ,  he  a  to  a  e 
b  all  times  to  estimate  accurately  the  load  the  olane  was  carrying  and  its 
center  of  gravity.  He  had  to  be  able  to  make  cc  fe  estimates  of  the 


191 


ckofs  ia  fad  coasumptio*  and  load  caused  by  a ay  special  4 

engine  faartiorinf  or  krefidarities  in  lT^tL  It  was  his  especial  respon¬ 
sibility  ia  operational  training  to  develop  aa  effective  team  to  czny  ** 
inspection  and  entizrjoas  observation  of  instruments  and  engines.  Lj* 
the  pilot  and  copust,  the  flight  tg^ineer  new  whenever  ids  plane  flew,  *. 
gardkss  of  the  purpose  or  nature  of  the  mission.  He  thus  received  the  fd 
120  to  126  boors  of  flying  time  specified  for  combat  crews  in  operation 

Job  $ptd£cad«H 

Certain  qualities  seemed  to  be  more  important  for  success  as  a  fijk 
engineer  than  others.  First  of  all,  regardless  of  the  situation  in  which  k 
found  hinv^f,  the  flight  engnm  bad  to  be  able  to  cany  oat — accurately, 
systems  Ckally,  and  quickly — the  arithmetic  compotatioos  necessary  a 
cruise  control  and  load  determination.  Second,  he  bad  to  be  a  good  "esti¬ 
mator.”  If  one  of  the  engines  started  to  backfire  and  bad  to  be  run  “auk- 
rich”  its  fuel  consumption  changed.  Skill  in  bring  able  to  judge  die  amoat 
of  such  change  was  important.  The  B-29  flight  engineer  also  had  to  hare 
sufficient  of  the  qualities  of  leadership  to  be  able  to  organize  the  enfiski . 
crew  members  into  an  efficient  team  to  keep  engines  and  instruments  under 
continuous  observation  at  all  times.  Finally,  in  common  with  other  mot¬ 
hers  of  the  crew,  he  had  to  be  cooperative;  for  he  had  to  coordinate  la 
activities  with  pilot,  copilot  and  na  -igator. 

CRITERIA  OF  PROFICIENCY 
General  Observations 

Observations  of  training  records  and  conversations  with  instructors  aad 
officers  in  charge  of  training  indicated  that  there  were  no  routinely  avail¬ 
able  records  that  would  be  of  much  value  in  determining  flight  engine* 
proficiency.  The  only  more  or  less  objective  record  which  seemed  likely  to 
provide  such  information  was  the  flight  engineer’s  log.  These  proved  to  he 
very  disappointing  under  current  practices.  Evaluation  of  these  logs  wtt 
neither  systematic  nor  standardized  although  the  form  was  prescribed  Du* 
ferent  instructors  at  the  same  station  often  used  different  procedures  in 
evaluation.  Discrepancies  between  estimated  and  actual  fuel  remaining  at 
the  end  of  a  flight  were  considered  as  a  possible  source  of  information  on 
proficiency.  However,  no  such  records  were  ordinarily  kept  and  any  at¬ 
tempt  to  use  such  a  criterion  would  have  required  the  institution  of  a 
special  report.  In  the  absence  of  more  objective  criteria  research  personal 
were  for  the  most  part  forced  to  fall  back  upon  subjective  judgments  m 

their  evaluation  of  flight,  engineer  proficiency  in  operational  training. 

$ 

Ratings  by  Instructorii 

In  an  attempt  to  de^  Jop  procedures  for  the  evaluation  of  crews  ai 
potential  lead  crew  matei  .al,  two  descriptive  rating  scales  were  constructed 
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m  the  Second  Air  Force.  These  sales  required  five-point  oa  etch  of 
jrreral  traits  for  each  aircrew  officer,  with  some  ratfsgs  Joe  the  crew 
as  a  whole.  Scale  A  was  administered  at  fear  CCTS  stations  (VH)  while 
Scale  B  was  administered  at  two  OTt*  (VH)  stations  and  two  other  CCTS 
(VB)  stations.  £acc  sale  was  administered  to  a  of  bqw  thaa  ISO 
ctss  Wherever  posset  two  independent  nliojs  were  on  ea^k' 

crew  member  on  each  scale  itun.  More  detailed  iefonnation  on  they  rit- 
sp  **  H  on  Lead  Crew  Prafideacy,  and  chapter  4,  Ak- 

jhae  Commander. 

Tbe  two  rating  scales  differed  greatly  is  tier  items  for  ffigK*  a&attn. 
Scale  A  contained  three  sech  items.  The  qualities  to  be  ratal  were:  Abffity 
ta  meet  unexpected  changes  in  flight  plan;  ability  to  lead  and  sqpcrrae 
•tier  crew  members;  and  general  lad  crew  proficiency,  Scale  B 
seres  items  for  rating  flight  engineers  imno*ving  these  qualities;  SmtaKBty 
far  lead  crew  assignment;  adequacy  of  preilight  piucedores;  interest  ia 
tie  job;  proficiency  In  anise  control  procedures;  ability  to  plan  ahead; 
cooperation  with  the  rest  of  the  crew;  and  over-all  proficiency.  In  taHe 
11  are  given  separate  distributions  of  ratings  on  each  sale  obtained  with 

Tssss  8J- — DistrSnctio *  of  fiikt  cstpmeer  rafts*? 
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each  flight  engineer  item  and  distributions  of  the  combined  ratings  for  j 
such  Items.  In  table  8  J  are  shown  the  liabilities  of  the  total  ratings  tx- 
pressed  by  conditions  between  the  pairs  of  independent  ratings  of  & 
same  flight  engineers.  The  correlations  wtre  first  computed  separately  i« 
each  administrative  unit — CCTS  dass  or  section  and  OTU  sqcadnm.  Tfe* 
coefficients  were  then  converted  to  the  corresponding  x  values,  average 
and  the  resulting  average  x  converted  to  the  corresponding  r.  In  this  k*. 
ner  station  tendencies  to  rale  hig"  or  low  do  not  contribute  to  the  observe 
reliability.  The  reliability  of  0.60  and  the  wide  range  of  scores  obtain 
with  both  scales  are  encouraging. 

Tams  tl.—Camiatians  between  independent  ratines  aj  fdgbt  engineers 
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Proficiency  Check  lint 

A  rather  different  approach  to  the  problem  of  estimating  crew  proSdencj 
is  found  in  the  Crew  Proficiency  Check — VHB  developed  in  the  Third  tit 
Force.  With  this  instrument,  an  instructor  observing  a  mission  checked  oae 
of  various  alternatives  under  each  of  more  than  50  items.  One  of  that 
items  referred  specifically  to  the  flight  engineer.  In  this  item  the  instruc¬ 
tors  were  asked  to  check  whether  the  flight  engineers  made  use  of  a  flight 
plan  and  gave  data  to  the  pilot,  or  whether  they  merely  recorded  the  plane 
performance  in  their  logs.  This  item  of  the  Crew  Proficiency  Check  was 
used  with  120  flight  engineers.  Active  participation  was  noted  for  35,  and 
passive  recording  of  data  for  75  for  these  flight  engineers.  In  10  cases  the 
instructors  felt  that  the  behavior  of  the  flight  engineer  did  not  fit  into 
either  category.  No  reliabilities  are  available  for  ratings  on  the  Crew  Pro¬ 
ficiency  Check. 

Ground  School  Grader  1 

Still  another  criterion  c  i  proficiency  in  operational  training  was  the  per¬ 
formance  of  the  individual  in  his  ground  school  classes.  This  performance 
of  the  individual  was  so  metimes  recorded  in  the  form  of  separate  scores 
on  one  or  more  written  pi  oficiency  tests,  or  it  represented  the  grade  given 
for  a  whole  course.  The  latte:  in  turn  may  have  been  obtained  by  averaging 
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%  cssd btt  of  test  scores  or  it  may  have  been  an  entirely  subjective  estimate 
^  tie  instructor.  Procedure  varied  greatly  from  station  to  la  a 

gftfe  Air  Force,  and  probably  varied  still  more  from  ooe  Air  Force  to  aa> 
However,  since  many  of  the  duties  of  the  flight  and  also 

of  the  navigator  were  of  the  nature-  of  “paper  work”  there  is  perhaps  better 
Kason  to  use  performance  in  ground  school  as  a  criterion  th*n  is  the  case 
•  d  other  numbers  of  the  aircrew. 

For  two  classes  of  flight  engineers  at  Ardmore,  the  correla tsens  between  . 
frase  n  and  Phase  HI  average  ground  school  grades  were  0.54  (N  of  56) 
sad  0J2  (N  of  55).  Grades  for  these  phases  may  be  considered  as  first 
taif  and  second  half  division  of  the  training  and  the  correlation  between 
Ifcon  is  to  a  certain  extent  a  measure  of  their  reliability. 

The  correlation  between  grades  on  the  over-all  final  examimtioa  in  En¬ 
gineering  and  on  the  final  Cruise  Control  examination  for  th;  11-21  class 
of  B-29  engineers  at  Albuquerque  was  0.10.  The  number  of  cases  is  smalt 
bat  there  seems  to  be  little  agreement  between  achievement  in  the  coarse 
2$  a  whole  and  knowledge  of  cruise  control.  For  this  same  sample,  the  cor- 
relations  between  rating  scale  B  total  scores  (raters  1  and  2)  and  the  two 
examinations  were  virtually  zero. 

la  the  16th  Wing  of  the  Second  Air  Force,  the  trainees  in  five  classes 
were  divided  into  “high”  or  “low”  groups  on  the  basis  of  their  average 
ground  school  grades.  Biserial  correlation  coefficients  between  this  “hfrh* 
tow”  criterion  and  Rating  Scale  A  total  scores  are  presented  in  table  8-3. 
The  combined  coefficient  indicates  a  low  bat  statistically  significant  (one 
percent  level)  relationship  between  these  two  criteria. 


Tistz  8J. — Correlations  between  rating  scale  A  total  scores  and  ground  school  grades 
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VALIDATION  STUDIES 

Ratings 

In  table  8.4  are  given  the  correlations  between  the  stamnes  of  the  flight 
engineers  and  the  total  ratings,  averaging  the  scores  of  two  raters  for  the 
Sight  engineer  items  of  Scales  A  and  B.  These  coefficients  were  computed 
in  two  ways.  First,  separate  coefficients  were  computed  for  each  CCTS 
ctass  or  OTU  squadron.  A  coefficient  was  then  obtainc  ’  for  the  total  group 
hy  Fisher’s  weighted  z  method.  Second,  all  cases  on  e.ich  scale  were  com¬ 
bined  in  a  single  group  and  a  coefficient  obtained  in  th-  usual  way.  Only 
the  validity  of  the  navigator  stanine  against  the  rating  i  ined  on  Rating 
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Scale  A  is  markedly  different  from  zero,  this  coeBdent  being  significant  * 
the  ooe  percent  kveL  This  is  not  corroborated  by  the  data  from  the  17ft 
Wing  (Scale  B)  In  general,  the  resells  indicate  that,  with  tins  exception 
the  stanines  did  not  predict  the  judgments  of  instructors  regarding  the  pro. 
fidency  of  flight  engineers. 


Tiiu  S.4. — Correlations  between  steals  :s  end  rating  sedt  Kent  ( raters  j  mi  2)  • 
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It  is  of  %-rest  to  note  that  the  addition  of  another  rater  did  not  in  this 
case  appreciably  affect  validity  of  the  pilot  stanine.  With  a  single  rater 
the  correlation  between  rating  scores  ax'd  pilot  stanine  was  0.06  and  0.03 
for  Scales  A  and  B  respectively.  ’ 

Groan  i  Jichool  Grade*  '  '  . 

1 he  cot  relation  between  the  augmented  pilot  stanines  of  flight  engineer*  ' 
a ad  their  ground  school  grades  expressed  ait  “upper5’  and  “lower  half*  of 
the  class  ’vas  0.19.  These  data  were  obtained  .from  four  CCTS  (VH  j  classes 
in  the  16  th  Wing  and  the  coeffic'^r-  given  is  the  weighted  x  average  eqo£ 
valent  of  the  coefficients  for  the  four  separate  classes.  The  combined  validity 
coefficient  for  a  total  of  129  cases  is  significant  at  the  5  percent  level 

The  correlations  between  the  pilot  and  navigator  stanines  of  the  flight 
engineers  in  the  8-21  class  at  Albuquerque  and  their  grades  in  the  over-al 
final  examination  in  Engineering  and  final  Cruise  Control  examination  are 
given  iit  table  8.S.  Just  as  a  matter  of  interest,  the  multiple  correlation 
betwee  i  navigator  stanines  and  the  combination  of  the  two  examinations 
was  computed.  Not  much  reliance  can  be  placed  on  the  high  value  of  OM 
obtained,  since  the  number  of  cases  h  so  small.  :  . 


Table  8.S. — Correlation  between  stanines  and  ten'  scores 
B-29  CREWS— SECO.'O)  AIR  FORCE 
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SUMMARY 


la  view  of  the  snvtH  amount  of  data  obtained  by  the  time  of  cessation 
af  hostilities,  it  is  dilneult  to  make  as  evaluation.  The  negative  results  in 
£4  could  be  explained  in  at  least  three  ways:  i)  The  qualities  ex*' 
by  the  pilot  stanine  are  sot  important  for  operational  training  of 
flight  engineers;  2}  The  well-known  sources  of  error  in  subjective  ratings 
gale  them  inadequate  as  a  criterion  of  proficiency;  3)  The  narrowing  of 
aoge  of  critical  abilities  by  successive  selections  coupled  with  a  great  deal 
of  variation  in  amount  and  type  of  previous  training  may  make  the  small 
jodividual  differences  in  ability  actually  present  a  relatively  small  factor  la 
the  observed  variations  in  performance.  Much  additional  study  will  be 
nquired  before  definite  conclusions  can  be  made  as  to  validities  of  stanlnes 
or  classification  tests  against  flight  data.  However,  It  seems  likely  that  the 
navigator,  and  to  a  less  extent  the  pilot  and  bombardier,  stanines  of  flight 
japneers  do  predict  their  success  in  ground  school  courses  in  operational 
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CHAPTER  NINE _ 

Radar  Observer 


ANALYSIS  OF  DUTIES  AND  SPECIFICATIONS 
Job  Analysis 

As  with  the  position  of  flight  engineer,  that  of  radar  observer  was  a  re¬ 
cent  addition  to  the  specialties  of  the  combat  crew.  In  operational  train¬ 
ing,  in  the  Continental  Air  Forces,  radar  observers  were  included  only  os 
VHB  (B~29,  B-32)  crews.  On  such  ere  vs,  tl.eir  main  role  was  in  naviga¬ 
tion  and  in  the  bombing  of  targets  ob seized  by  clouds  or  darkness,  etc 
In  both  navigation  and  bombing  the  radar  observer,  though  important,  was 
only  one  of  cooperating  team;  and  the  success  of  the  operation  was  the 
joint  outcome  of  the  activities  of  ell  team  members.  In  navigation  the  team 
included  the  navigator,  radar  observer,  airplane  commander  and  flight  en¬ 
gineer.  In  bombing  the  team  consisted  of  bombardier,  radar  observer,  air¬ 
plane  commander  and  nav 'gator.  '  ; 

Obviously,  the  fundamental  job  of  the  radar  observer  was  the  handling  of 
the  radar  equipment.  This  included  the  usual  preflight  checks,  getting  the 
set  in  operation  and  tuning,  minor  repairs  in  flight  and  interpretation  of 
data  from  the  sets  for  use  in  the  desired  operations.  By  identifying  the 
patterns  appearing  on  the  “scope,”  the  radar  observer  could  make  position 
fixes  in  navigation  regardless  of  visibility.  Range  and  bearing  of  all  check 
points  codd  also  be  obtained  from  the  instrument.  Accurate  ground  speeds, 
tracks  and  winds  could  De  determined  for  use  in  pilotage  and  DJI  naviga¬ 
tion.  In  bombing,  the  information  for  setting  up  and  synchronizing  the 
bomb  sight  was  provided  by  the  radar  observer  when  the  target  was  not 
visible  to  the  bombardier. 

Since  in  each  case  the  radar  observer  was  a  member  of  a  team  cooperat¬ 
ing  in  the  operation,  how  effectively  the  information  obtained  by  radar  was 
presented  to  the  other  officers  concerned  was  as  important  as  the  skill  of 
the  radar  observer  in  handling  the  equipment  itself.  In  navigation  the  radar 
observer  and  navigator  worked  independently,  but  each  checked  the  other’s 
work  against  his  own.  In  this  manner  an  accurate  check  was  obtained  of 
most  of  the  computations,  of  the  calculations  of  position  and  of  the  various 
values  to  be  used  in  setting  up  the  bomb-sight  in  the  radar  bombing 
operation.  During  the  bombing  operation,  the  radar  observer  provided 
the  bombardier  with  information  to  set  up  arid  synchronize  the  bomb  sight 
and  then  issued  corrections  on  the  basis  of  the  evidence  from  "the  radar 
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scepe.  Then,  if  the  target  appeared  in  view  at  any  time,  the  bombardier 
was  prepared  to  switch  immediately  to  visual  bombing.  If  such  was  fm- 
possible,  release  was  made  on  the  basis  of  the  radar  settings  foe  the  usual 
radar  bombing  run. 

The  detailed  description  of  the  job  of  the  radar  observer  in  the 

equipment  and  in  making  the  necessary  adjustments  and  computations  In 
navigation  and  bombing  is  beyond  the  scope  of  this  report  Such  can  be 
obtained  from  a  study  of  appropriate  manuals  and  from  Aviation  Psycho¬ 
logy  Research  Report  Number  12:  Psychological  Research  on  Radar  Ob¬ 
server  Training. 

job  Specification* 

Successful  handling  of  radar  equipment  undoubtedly  required  a  high 
degree  of  ability  to  identify  ambiguous  and  relatively  unstructured  visual 
patterns  and  to  correlate  a  series  of  such  patterns  with  features  on  maps  of 
the  terrain  being  covered.  In  the  actual  manipulation  of  the  equipment, 
it  was  particularly  important  that  the  radar  observer  be  skillful  in  adjusting 
various  electrical  controls  so  as  to  give  maximum  definition  and  clarity  to 
the  image.  The  ability  to  make  fine  manipulations  under  visual  control  was 
probably  of  primary  importance  here.  Knowledge  of  the  fundamental  prin¬ 
ciples  of  radar  operation  and  mastery  of  the  details  of  the  equipment  used 
were  necessary  for  in-flight  repairs  and  adjustments  and  for  the  interpreta¬ 
tion  of  any  unusual  features  of  operation  of  the  equipment  The  necessity 
of  operating  as  a  member  of  a  team  made  ability  to  cooperate  in  a  small 
group  extremely  important.  A  willingness  to  check  all  observations  against 
reports  of  other  crew  members  and  ability  to  discover  reasons  for  any 
disagreements  encountered  were  essential  to  success  in  this  specialty  in  the 
operational  training  of  combat  crews.  , , 

CRITERIA  OF  PROFICIENCY 

.  .  .  _  •  •  > '  / 

General  Observations 

In  addition  to  the  usual  difficulties  brought  about  by  differences  in  train¬ 
ing  procedures,  differences  in  equipment  and  differences  in  records  main¬ 
lined,  studies  of  proficiency  of  radar  observers  had  to  meet  the  difficulty 
that  officers  of  this  specialty  were  frequently  not  available  for  assignment . 
to  crews  until  all  or  a  part  of  operational  training  had  been  completed. 
Furthermore,  methods  of  evaluating  radar  bombing  performance  were 
in  process  of  change  and  it  proved  very  difficult  to  obtain  extensive  data 
on  any  particular  measure  of  radar  observer  proficiency.  Two  main  types 
of  measures  of  proficiency  were  finally  obtained  for  various  groups  of  radar 
observers  in  the  Continental  Air  Forces.  These  we»  ratings  by  instructors’ 
and  radar  bombing  average  circular  error  scores.  A  few  additional  measures 
Were  also  explored  with  smaller  numbei  of  crews. 
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Rating*  by  Instructor* 

Mission  Ratings 

Three  samples  of  instructors  ratings  were  obtained  in  the  Fourth  Ah 
Force  on  radar  observers  in  training  a:  the  Lead  Crew  School,  Muroc  Army 
Air  Field,  Muroc,  Calif.  The  rating  scale  used  was  constructed  by  radar 
instructor  personnel  at  the  school,  all  of  whom  were  combat  returnees.  The 
scale  required  instructors  to  rate  the  students  on  each  of  six  items 
a  five-point  scale.  Weights  were  assigned  to  each  of  the  items  so  as  to  re¬ 
sult  in  a  maximum  score  of  100  for  all  items.  This  score  from  all  the  items 
is  referred  to  in  the  following  discussion  as  the  mission  average  rating.  Ia 
addition  to  the  scores  on  the  items,  the  instructors  also  made  an  over-all 
appraisal  of  the  radar  observer,  using  a  five-point  scale.  The  reliabilities 
'  of  the  over-ail  and  the  mission  average  ratings  are  presented  in  table  9.1. 
Separate  coefficients  were  computed  for  each  sample  between  the  ratings 
for  odd  and  even  missions.  Only  ratings  by  different  instructors  were  in¬ 
cluded  in  these  comparisons.  These  were  corrected  by  the  Spearman-Brown 
formula.  The  weighted  average  of  the  coefficients  for  all  samples  was  then 
obtained.  ' 


Tabu  9.1  .—Reliability  coefficient:  of  overate  and  over-att  mission  rating:  of 

radar  observer 
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Two  rating  scales  were  constructed  by  research  personnel  in  the  Second 
Air  Force  to  be  used  in  evahiating  the  performance  of  radar  observers. 
Both  scales  are  described  in  some  detail  in  the  chapter  on  Lead  Crews, 
Chapter  11.  In  Descriptive  Rating  Scale  A,  used  in  the  16th  Wing,  insti  ac¬ 
tors  were  required  to  rate  the  radar  observer  trainees  on  a  five-point  scale 
on  each  of  five  items:  scope  interpretation,  adjustment  of  equipment,  main¬ 
tenance  of  records,  and  lead  crew  potentialities.  In  Scale  B,  used  in  the 
17th  Wing,  instructors  were  called  upon  to  rate  trainees  in  a  simitar  man¬ 
ner  upon  these  five  items:  lead  crew  potentialities,  use  of  equipment,  inter¬ 
est  in  duties,  ability  to  work  with  others,  and  relative  petition  of  the 
trainee  in  his  group.  Distributions  of  ratings  on  the  Scales  are  shown  in 
table  9.2.  Reliability  coefficients  for  the  two  scales  are  shown  in  table  9.3. 
These  were  obtained  by  comparing  the  sum  of  the  ratings  given  by  one  in¬ 
structor  with  the  sum  of  the  ratings  given  by  another  instructor.  In  the 
computations  of  these  coefficients,  whenever  a  rating  of  a  trainee  on  one 
item  was  omitted  by  a  rater,  the  median  rating  given  by  that  rater  to  that 
trainee  on  the  other  items  w;.s  used  for  the  omitted  item. 
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TjUU  Us— Distributions  of  radar  observer  rotiap 
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Tabu  9J. — Reliability  coefficients  of  radar  observer  ratings 
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Radar  Average  Circular  Error 

A  detailed  description  of  radar  average  circular  error  scores  is  presented 
in  Chapter  7  in  discussions  of  various  bombing  scores.  Reliabilities  or  ree 
radar  bombing  scores  used  in  the  Fourth  Air  Force  are  shown  in  ta  c  .  . 
These  coefficients  represent  the  correlation  between  average  scores  or 
and  even  missions  corrected  by  the  Spearman-Biown  formula  for  ea  o 
several  classes  separately  and  for  the  total  group.  Tn  the  Second  Air  *orce 
reliability  coefficients  were  obtained  by  computir,  separately  the  corre¬ 
sponding  T-scores  for  each  type  of  radar  bombing  score:  Photo  Score 
(Victorville),  Photo  Score  (Nadir)  and  Radar  Score  (Automatic),  These 
T-scores  were  then  combined  into  average  over-all  o  an  c\ en  on 
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ndar  CS  T -Score*.  Case*  which  did  not  have  at  kast  four  scores  b  «« 
type  were  discarded.  Since  T-scores  were  determined  from  distribution  , 
each  type  by  station,  all  cases  (torn  different  stations  were  abo  combi** 
(Erectly.  Reliability  coefficients  obtained  in  this  way  are  shown  in  tab*  tj. 
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Ground  School  Grades 

Ground  school  grades  in  terms  of  “upper”  and  “lower”  half  of  the  class 
were  obtained  for  each  member  in  one  class  at  e'.ch  jf  four  combat  crew 
training  stations  (VH)  in  the  Second  Air  Force.  I'  was  not  possible  to 
determine  the  reliability  of  these  data. 


Number  of  Radar  Bombing  Missions  Completed 

For  one  rlacs  at  each  of  seven  bases  the  number  of  radar  bombing  mis¬ 
sions  accomplished  by  crews  within  a  specific  period  of  time  were  deter¬ 
mined.  It  was  not  possible  to  compute  the  reliability  of  this  criterion  of 
'  proficiency. 


General  Evaluation 

t 

Relations  Between  Criteria 

The  intercorrelations  of  three  criteria  available  for  radar  observers  in  the 
Fourth  Air  Force  are  shown  in  table  9-6.  The  relationship  of  rating  scale 
scores  to  other  criteria  available  for  radar  observers  are  shown  in  tables 
9.7,  9.8  and  9.9. 

Evaluation 

1.  Taken  as  a  group,  the  various  rating  scale  scores  were  of  sufficient 
reliaoility  to  be  useful  for  validation  purposes.  The  distribution  of  £»’•<* 

202 


A*«5***Jfc  ****  0 


gores  was  good.  It  Is  recognized  that  the  samples  available  for  any  out 
scale  were  small.  However,  from  sample  to  sample  the  coefficients  wen 
fairly  consistent.  Descriptive  ratings  such  as  were  used  here  are  naturally 
spew  to  the  usual  subjective  sources  of  error.  In  this  connection,  it  b  likely 
f|»»t  the  mission  ratings  were  less  subject  to  such  errors  th*n  over-all  do* 


Tuu  9.6. — Interctmlations  of  radar  bombing  criteria 
JUNE,  JULY  AND  AUGUST  CLASSES  MUROC  AAF — FOURTH  AIR  FORCE 
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Tabu  9.7. — Correlations  belts  een  rating  scale  scores  and  ground  school  grades 
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Tab ix  9.8. — Correlations  between  total  rating  scale  scores  and  radar  terminal 

ACB  T-scores 
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Tabtx  9.9. — Correlations  of  number  of  missions  completed  in  radar/camera 
bombing  training  and  total  rating  scale  scores 
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scrip tive  ratings,  since  attention  was  directed  upon  performance  rather  thu 
upon  the  individual.  The  average  and  over-all  mission  ratings  in  the  Fourth 
Mr  Force  were  probably  sufficiently  highly  correlated  to  warrant  droppi&g 
one  of  these  in  the  validation  studies.  Both  scores  also  appeared  to  have 
the  same  relation  to  the  various  measures  of  bombing  accuracy.  However, 
since  the  additional  work  involved  was  not  great,  both  measures  were  in- 
'  eluded  in  the  few  studies  that  were  made. 

2.  Measures  of  bombing  accuracy  in  both  Second  and  Fourth  Air  Forces 
showed  sufficient  reliability  to  be  useful  in  validation  studies.  Such  scores 
have  the  great  advantge  of  being  little  affected  by  subjective  sources  of 
error.  Chief  disadvantage  of  these  scores  were  the  frequent  changes  in 
method  of  determining  bombing  error  and  the  presence  of  various  types  of 
clerical  and  computational  errors  in  the  available  records.  It  should  be 
noted  that  the  radar  bombing  score  reflected  not  only  the  proficiency  of  the 
radar  observer  but  that  of  the  pilot,  navigator  and  bombardier  as  well. 
This  point,  frequently  mentioned  in  connection  with  bombardier  profi¬ 
ciency,  is  esftecially  important  in  the  case  of  radar  observer  proficiency  be¬ 
cause  of  the  wide  variation  found  among  crews  with  regard  to  the  role 
played  by  the  radar  specialists.  In  some  crews,  the  radar  member  was  the 
key  person;  in  others,  he  played  the  role  of  a  minor  assistant  In  some 
crews  his  duties  were  taken  over  completely  by  the  navigator  ;  in  others,  the 
radar  observer  performed  major  duties  of  both  the  navi:v  '.or  and  bom¬ 
bardier.  Thus,  the  adequacy  of  the  bombing  score  as  a  criterion  of  profi¬ 
ciency  for  the  radar  observer  may  be  seriously  questioned,  since  no  standard 
part  of  the  bombing  procedure  may  be  assumed  for  all  radar  observers. 

3.  Ground  school  grades  as  criteria  of  proficiency  for  radar  observers 
are  subject  to  the  same  general  criticisms  that  are  made  in  the  case  of  other 
aircrew  positions.  First,  not  all  subjects  are  graded.  Also  many  subjects 
that  are  graded  have  no  obvious  bearing  on  the  trainee’s  task  as  a  radar 
technician,  being  concerned  with  the  fact  that  the  technician  is  also  a  sol* 
dier.  In  no  case  was  it  possible  to  determine  the  reliability  of  either  single 
grades  or  averages  of  all  grades.  In  general,  the  prediction  of  ground  school 
success  is  not  likely  to  be  a  worthwhile  enterprise  unless  eliminations  from 
training  are  sometimes  made  on  the  basis  of  ground  school  performance. 
Such  occurred  very  rarely  in  operational  training. 

4.  The  correlations  between  radar  observer  ratings  and  various  measures 
of  radar  bombing  accuracy  are  low.  A  possible  reason  for  this  is  the.fact 
that  while  the  instructors  attempted  to  rate  the  radar  observer  on  his  per¬ 
formance  in  the  bombing  operation,  the  actual  bombing  accuracy  probably 
also  depends  upon  the  performance  of  several  other  crew  members.  Further¬ 
more,  the  radar  bombing  scores  were  usually  :-?ot  known  to  the  instructors 
who  were  making  the  ratings  of  radar  observers  This  is  in  marked  con¬ 
trast  to  the  situation  with  respect  to  the  bombardier  where  the  average 
circular  errors  were  known  to  and  were  frequently  consulted  by  Instructors 
rating  bombardiers. 


VALIDATION. 3TUDIE3.  - 

•*  *  •  *  t  . 

General  OUmallooi  • "  *  - 

The  studies  in  this  section  are  not  strictly  speaking  validation  projects 
in  the  sense  that  a  specific  selection  procedure  was  being  validated 
success  in  a  specialty  for  which  it  was  designed.  In  the  following  studies^ 
the  bombardier,  navigator  and  pilot  stamnes  of  radar  observers  are  com¬ 
pared  with  a  number  of  measures  of  proficiency.  No  evaluation  is  made  of.  - 
the  validity  of  specific  techniques  developed  by  the  Psychological  Research  ' 
Project  (Radar)  for  the  selection  and  classification  of  radar  observers. 

As  was  the  case  with  other  aircrew  positions,  research  personnel  found  It 
necessary  to  spend  considerable  time  in  the  evaluation  of  existing  criteria 
of  proficiency  and  the  development  of  new  measures.  This  analysis  teas  ' 
considered  necessary'  before  validity  coefficients  could  be  appraised  ade*  ’ 
quatdy.  In  the  following  discussion,  validity  coefficients  significant  at  the  « 

I  percent  level  (i.e.  could  occur  by  chance  less  than  1  time  in  100)  are  f 
identified  by  2  asterisks  and  coefficients  significant  at  the  5  percent  level 
are  marked  with  a  single  asterisk. 

Starring  Validation  .  . 

Rating  Scales  \ 

Examination  of  table  9.10  suggests  that,  in  general,  the  bombardier,  navi- 
gator  and  pilot  stanines  have  very  low  validity  for  predicting  proficiency  in 
radar  observer  training  as  measured  by  rating  scale  results.  The  1  correla¬ 
tion  coefficient  significant  at  the  5  percent  level,  that  between  the  bon 
hardier  stanine  and  rating  scale  score  icr  the  16th  Wing  is  not  corroborated 
by  results  in  the  17th  Wing. 

The  correlation  between  the  bombardier,  navigator  and  pilot  stanines  of- 


■  *  f 

Table  9.10. — Correlations  between  stanines  of  radar  observers  and  . 

total  ratini  scale  scores  ■  ' 


SUM  OF  2  RATERS,  I6ti  AND  17th  tVINGS — SECOND  AIR  FORCE 


wmblala*  all  d»u  directly. 
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radar  observers  at  Muroc  AAF  and  ratings  by  instructors  are  given  in  tabie 
9.11.  None  of  the  coefficients  is  significantly  different  from  zero. 

Tam*  9.1!.— Conditions  between  mints  by  instructors  and  stanines  of  radar  absent,, 
ti  RADAR  OBSERVERS— MUROC  AAF—  FOURTH  AIR  fORCR 
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Tables  9.12  and  9.13  indicate  that  stanine  validities  are  also  consistently 
low  when  Radar  Average  Circular  Error  Scores  are  used  as  the  criterion. 

Table  9.12. — Correlations  between  bombardier  and  navigator  stanine  of  the  radar 
observer  and  radar  average  circular  error  (T- scores) 
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Table  9.13. — Correlations  between  radar  bombing  scores  and  stanines  of  radar  observer 
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In  the  single  sample  for  which  data  were  available,  neither  the  bom¬ 
bardier  nor  navigator  stanines  were  significantly  correlated  with  ground 
school  grades.  The  data  are  given  in  table  9.14.  This  result  is  in  contrast 


to  that  obtained  in  mo»t  of  the  other  aircrew  specialties  where  the  navigator 
5120100  usually  had  some  correlation  with  ground  school  performance. 


Tamjc  9.14. — Correlations  between  bombardier  end  navigator  stanhtes  amd 
p  ound  school  grades  0}  radar  observers 
iitk  WING— SECOND  AC  FORCE 


Number  of  Radar  Bombing  Missions  Completed 


The  results  presented  in  table  9.15  suggest  that  bombardier  and  navigator 
stanines  are  negatively  related,  (significant  at  the  five  percent  level)  to 
radar  observer  proficiency  as  measured  by  number  of  radar  bombing  mis¬ 
sions  completed  within  a  specific  period.  This  result  is  difficult  to  interpret 
since  as  discussed  above,  it  is  rather  doubtful  that  the  radar  observer  in¬ 
fluences  this  measure  to  any  great  extent  either  favorably  or  unfavorably. 
However,  analysis  of  the  data  in  the  table  indicates  that  one  class,  Walker, 
with  a  high  negative  coefficient  was  the  major  source  of  these  results.  This 
coefficient  is  markedly  different  than  th^se  obtained  with  other  samples, 
none  of  which  provided  coefficients  significantly  different  from  zero.  It  is 
possible  that  some  spurious  unknown  factor  was  operating  to  prouuce  these 
results,  and  that  the  true  correlation  between  stanines  of  radar  observer 
and  number  of  missions  completed  is  zero.  , 


Tabus  9.15. — Correlations  between  number  of  radar  missions  completed 
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1  Positive  sign  of  r's  indicates  a  positive  association  between  high  stanine  and  high  number  of 
Bbriom. 


Evaluation 

Stanines  of  radar  observers  show  little  relationship  to  the  measures  of 
proficiency  discussed  in  this  chapter.  It  is  suggested  that  the  inadequacy 
of  the  criteria  was  a  major  factor  in  this  result.  With  the  possible  exception 
of  rating  scale  scores  (which  are,  in  turn,  subject  t'  limitations  of  their 
own)  no  criteria  were  availaole  which  were  deperu  _at  solely  or  even 
primarily  upon  radar  observer  proficiency.  Further  research  in  the  develop¬ 
ment  of  measures  of  proficiency  for  radar  observers  is  •  arly  indicated  as 
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well  u  a  better  standardization  of  bis  duties.  This  lack  of  standardiza#* 
reduces  the  confidence  one  would  ordinarly  have  in  the  adequacy  of  rad* 
bombing  scores  rs  criteria  of  radar  observer  proficiency.  In  connection  vftfc 
the  lew  validities  reported,  it  is  worth  repeating  that  the  stanines  on  which 
these  studies  were  based  were  not  developed  to  predict  the  proficiency  fa 
radar  observers.  . 

SUMMARY 

Research  on  radar  observers  was  largely  limited  to  examination  of  exit¬ 
ing  criteria  and  the  development  of  ratings  of  proficiency  in  this  specialty. 
Among  the  existing  criteria  only  radar  bombing  accuracy  scores  were  found 
suitable.  Over-all  descriptive  ratings  were  tried  out  in  the  Second  Air 
Force  and  mission  ratings  in  the  Fourth  Air  Force.  None  of  the  proficiency 
criteria  that  were  studied  were  considered  suitable  as  measures  of  n.iar 
observer  performance.  Stanines  of  radar  observers  showed  little  or  no  cor¬ 
relation  with  any  of  the  available  criteria. 
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CHAPTER  TB1 


Flexible  Gunnery 


ANALYSIS  OF  DUTIES  AND  SPECIFICATIONS 
Job  Analyni* 

No  formal  job  analysis  of  flexible  gunnery  was  made  in  the  Continental 
Air  Forces.  However,  certain  general  observations  and  analyses  of  details 
of  operational  training  made  in  the  Second  Air  Force  are  pertinent  to  the 
data  which  were  obtained.  In  this  connection  it  should  be  pointed  out  first 
of  all  that  each  gunner  had  duties  in  addition  to  the  defense  of  the  aircraft 
against  attacks  by  hostile  planes.  Since  the  nature  of  these  duties,  as  well 
as  the  nature  of  the  gunners’  task  itself,  were  rather  different  in  heavy  and 
very  heavy  bombardment  operations,  a  brief  description  of  duties  In  the 
two  types  of  aircraft  is  given  in  the  following  paragraphs. 

B-17  and  B-24  aircraft  normally  had  six  gun  positions:  nose,  tail,  upper 
and  lower  turrets  and  two  waist  guns.  The  upper  and  lower  turrets  utilized 
computing  sights  while  the  rest  of  the  guns  were  hand  sighted.  Because  the 
task  involved  was  somewhat  different,  attempts  were  made  to  give  all  gun¬ 
ners  experience  in  the  operation  of  both  types  of  sights.  Until  the  fall  of 
1944  the  usual  heavy  bombardment  crew  included  six  gunners  including  a 
radio  operator,  an  aerial  engineer  and  three  aerial  or  career  gunners.  Since 
the  bombardier  manned  the  nose  position,  five  of  the  gunners  manned  the 
five  remaining  guns  and  one  usually  served  as  a  relief  for  the  xest^  In  the 
fall  of  1944,  one  person  was  dropped  from  the  heavy  bombardm-eat  crews. 
In  half  of  the  crews  this  was  the  bombardier,  his  place  in  the  nose  being 
taken  by  the  armorer  gunner.  In  the  other  half  of  the  crews,  one  car®(* 
gunner  was  eliminated.  Two  of  the  regularly  assigned,  gunners,  the  aerial 
engineer  and  the  radio  operator  had  duties  other  than  gunnery  that  were 
probably  much  more  important.  These  positions  are  discussea  m  more  de¬ 
tail  in  Chapter  8  and  Chapter  11.  .. 

The  normal  B-29  crew  included  5  gunners.  These  manned  the  tail,  two 
waist  or  blister  guns  and  the  top  sighting  position.  The  radar  gunner  nor¬ 
mally  served  as  a  relief  for  the  rest.  All  gun  positions  had  computing  sights. 
However,  the  top  sighting  position  represented  a  task  rat  er  i  emn ‘ 
single  turret  operation,  since  it  served  ordinarily  or  ie  ren\°  . 

turret  operation.  The  RCT  gunner  occupied  this  position  andhadb» 
given  special  training  for  this  job.  The  repair,  >  ispec  ion 
remote  control  turret  equipment  was  his  main  i  ponsi  1 1 Y*  . 

to  their  gunnery  duties,  the  two  waist  or  blister  gunners  routinely  served  ^ 
scanners  to  observe  the  functioning  of  engines,  con'  ol  surfaces  and  landing 
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%nx  which  were  not  visible  to  other  crew  members.  Whuc  it  did  not  in¬ 
volve  any  high  degree  of  skill,  this  function  was  of  vital  importance  and 
received  great  emphasis  in  training.  In  contrast  to  the  heavy  bombard* 
ment  crew,  the  radio  operator  and  flight  engineer  on  B-29  aircraft  had  no 
gunnery  responsibility.  As  with  heavy  bombardment  crews,  the  nose  post* 
tion  was  manned  by  the  bombardier.  Certain  features  were  common  to  both 
heavy  and  very  heavy  bombardment  crews.  All  gunners  hrd  to  be  thor¬ 
oughly  familiar  with  their  equipment  and  with  any  auxiliary  equipment 
near  their  stations.  They  had  to  be  able  to  detect  and  correct  malfunctions 
of  their  guns  and,  if  possible,  make  minor  repairs  in  flight.  Their  job  was 
naturally  more  difficult  in  E — 29  aircraft  since  the  equipment  was  more  com¬ 
plicated.  In  the  B-29  there  was  in  addition  a  greater  problem  of  coordina¬ 
tion  between  gunners  in  the  use  of  remote  control  firing  equipment.  Finally, 
tbe  tail  gunner  had  certain  other  responsibilities.  In  all  formation  flying, 
the  tail  gunner  provided  rear  vision  for  airplane  commander  and  crew.  This 
aspect  of  his  duty  was  especially  important  when  his  plane  was  in  the  lead 
position.  In  B-29  aircraft  the  tail  gunner  was  also  responsible  for  starting, 
operating  and  turning  off  the  auxiliaiy  electrical  power  plant  or  “put-put” 

Gunners  received  three  types  of  training  in  operational  training:  ground 
school  courses,  practice  on  synthetic  trainers  and  firing  at  fighter  planes  in 
simulated  interceptor  attacks.  The  ground  school  courses  included  material 
on  theory  of  ballistics,  details  of  guns  and  equipment  and  their  operation, 
and  theories  of  formation  defense  and  position  firing.  The  type  of  trainer 
in  use  varied,  but  with  installation  in  the  fall  of  1911  of  E-14  or  Jam 
Handy  trainers  at  all  stations,  these  became  standard.  Training  on  gunnery 
missions  in  the  air  included  practice  in  operating  all  types  of  guns  against 
a  variety  of  attacks  by  fighter  planes.  Gun  cameras  mounted  on  guns  or 
sights  were  used  to  evaluate  the  performance  of  the  gunners.  Sometimes 
blank  ammunition  was  used  to  simulate  combat  conditions  more  closely 
Minimum  requirements  with  this  type  of  training  were  the  exposure  of  at 
least  SO  feet  of  gun  camera  film  on  each  of  4  missions  with  a  minimum  of 
1  fighter  attack  recorded  on  each  25  feet  of  film. 

Job  Specifications 

Except  for  the  last  year  of  the  war,  flexible  gunnery  received  consider¬ 
ably  less  attention  in  operational  training  than  did  the  other  specialties  of 
the  combat  crew.  It  was  difficult,  therefore,  to  obt?'u  clear  cut  evidence  as 
to  what  wet  a  the  most  important  qualities  for  success  in  this  task.  Observa¬ 
tions  of  the  operation  of  central  fire  control  equipment  and  o-  computing 
sights  led  to  the  conclusion  that  a  high  degree  of  skill  in  eye-hand  co¬ 
ordination  was  definitely  needed.  The  coordination  required  was  certainly 
as  complex  as  that  required  of  the  bombardier,  for  example.  Another 
quality  that  was  undoubtedly  important  for  the  ,;;roup  of  gunners  as  a 
whole  was  teamwork.  Coordination  between  individual  gunners  in  defense 
against  attacking  aircraft  was  just  as  important  as  was  coordination  be* 
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tween  other  crew  members  in  radar  bombing  and  fa  successful  operation  of 
tjj c  aircraft  on  long  distance  missions.  Alertness  was  particularly  important 
for  the  blister  gunners  that  acted  as  scanners.  Their  job  was  monotonous 
jnd  tended  too  often  to  be  neglected  until  after  an  emergency  had  already 
arises. 

%  • 

CRITERIA  OF  PROFICIENCY  • 

Ground  School  Grade* 

As  with  the  other  aircrew  specialties,  the  management  of  ground  school 
courses  varied  greatly  from  station  to  station.  Subject  matter  and  hours  of 
training  were  fairly  well  standardized.  Types  of  examinations  and  degree  of 
subjectivity  of  grades  given  were  the  chief  variants.  The  reliability  of  the 
average  ground  school  grades  of  B— 17  gunners  at  one  station  is  shown  fa 
table  10.1.  Also  shown  in  the  table  are  intercorrelations  between  scores  on 
three  examinations  for  students  at  a  gunnery  instructors  school  at  Pueblo 
AAB  in  the  Second  Air  Force.  The  reliability  of  one  of  these,  the  remote 
control  turret  examination,  was  determined  by  the  comparison  between 
scores  on  the  odd  and  even  items  of  the  test-  The  mean  score  on  the  test 
was  83.01,  the  standard  deviation  was  7.40  and  the  reliability  of  the  total 
test  0.74,  based  tin  data  flora  198  students.  Ground  school  grades  were  ob¬ 
tained  for  4  B-29  CCTS  classes  for  whom  ratings  on  Scale  A  were  ob¬ 
tained.  No  reliability  could  be  determined  since  final  grade  only  was 
obtained. 

Tabus  10.1.— Reliability  coefficient*  of  average  ground  school  grades—aS  course* 
B-17  GUNNERS-  bSCOND  AIR  FORCE 

B  =  Armorer  pinner  and  career  puem 


Class 

Number 

of 

cases 

1 

! 

p 

Grade  phase  III.  2 

Type  of  gunner 

Mean 

S.D. 

Mean 

S.D. 

12-10 

112 

76.9 

5.72 

5.56 

5.92 

3.48 

82.7 

8.14 

9.43 

it 

12-10 

196 

77.9 

4-1 

111 

80.8 

i.eo 

.59 

4-1 

190 

83.9 

Interccrrelations  between  test  score* 


Ratings  by  Instructor#  . 

Although  the  importance  of  such  duties  as  everywhere  recognized, 
there  were  no  records  available,  widen  gave  any  evidence  0  1  c 
proficiency  of  gunners  in  carrying  out  duties  other  than  gunnery,  u  jec 
ratings  by  instructors  were  thus  the  only  mean.  -  obtaining  estimates  o 
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this  proficiency.  In  connection  with.*  study  of  lead  crew  proficiency  two 
rating  scales  were  constructed  in  the  Second  Air  Force  and  administered 
to  a  number  of  B~29  crews  in  that  Command.  In  each  case  two  relatively 
independent  ratings  were  obtained  on  each  crew  rated.  Each  scale  coo. 
tained  items  referring  to  the  gunners  of  the  crews  being  rated.  In  both 
scales  the  gunners  were  referred  to  as  a  group  rather  than  individually. 
Ratings  were  handled  in  this  fashion  because  it  war  beloved  that  individ- 
ual  gunners  w«-;e  not  well  enough  known  to  be  rated  individually.  How* 
ever,  at  Biggs  Field  instructors  using  Scale  A  offered  to  rate  each  gunner  fa. 
dividually  on  each  of  the  two  items  referring  to  gunners.  Two  independent 
ratings  were  thus  obtained  at  Biggs  Field  for  164  gunners  of  41  crews.  I# 
table  10.2  arc  given  the  correlations  between  these  ratings.  Since  at  this  sta¬ 
tion,  gunners  were  regarded  as  interchangeable  between,  positions,  separate 
coefficients  were  no*.  computed  for  different  positions.  It  is  apparent  from 
the  results  shown  in  the  table  that  the  original  hypothesis  that  individual 
gunners  were  ntf  well  known  to  instruct*:  is  supported.  The  data  in  table 
10.3  suggest,  however,  that  instructors  agreed  moderately  well  in  their 
ratings  of  the  gunners  as  a  group. 


Tabu  10  2. — Correlations  between  independent  ratines  of  gunners 
,  BIGGS  FIELD— 41  CREWS— 164  GUNNERS 


■ 

First  rater.  / 

Second  niter,  Z 

rm 

Mean 

S.D. 

Mean 

S.D. 

Item  t . . . 

2.22 

2.23 

4.45 

0.66 

.65 

1.33 

2.35 

2.43 

4.80 

0.60 

.5* 

.85 

-o.« 

.00 

-.04 

Item  2 . - . 

Itemised!.,. . 

Tabu  10 J. — Reliability  coefficients  of  ratings  of  gunners  with  gunners  of  e 
crew  rated  as  a  group 
B-29  CREWS-SECOND  AIR  FORCE 
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N 

First  rat a,  1 

Second  rater,  t 

rm 

Mean 

S.D. 

Mean 

S.D. 

Seals  A: 

Alamofordo  3 . 

23 

23 

41 

36 

37 

5.35 

5.03 

4.66 

6.17 

5.57 

1.16 

1.12 

.93 

1.70 

1.32 

6.48 

5.00 

5.07 

6.83 

5.70 

1.09 

.83 

.71 

1.26 

1.78 

o.tt 

.41 

.24 

.30 

.41 

‘  Ahunorordo  6 . 

Bln* . 

Oovif . ; . 

Tucson . . . 

Combined  (amaft  by  Fisher's  >) . 

Scale  B: 

W.dker. . . 

160 

5.36 

1.40 

5.80 

l.*4 

.45 

17 

49 

27 

2.24 

2.44 

2.92 

.36 

.'?6 

JA 

3.30 

2.47 

2.72 

.53 

.92 

.42 

0.10 

.44 

.30 

ASK,^«et(jue . . . 

Fyote. . . . . . 

Combined  (average  by  Fisher's  i) . 

93 

2.62 

.73 

2.69 

.  .83 

.44 

The  biserial  coefficients  presented  in  table  10.4  between  ratings  and 
ground  school  grades  (with  students  divided  into  upper  and  lower  groups) 
indicate  that,  for  five  CCTS  (VH)  classes  in  the  Second  Air  Force,  grade* 
and  ratings  were  not  correlated. 
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Trainer  Score# 

The  type  of  gunnery  trainers  used  and  trainer  requirements  changed 
frequently  during  the  period  of  psychological  research  In  the  Continental 
Air  Forces.  Since  the  E-14  or  Jam  Handy  trainer  was  finally  selected  as 
standard  most  of  the  data  obtained  are  from  this  trainer. 

The  task  of  the  gunner  with  this  trainer  was  to  follow  with  his  sights 
an  image  of  a  plane  projected  upon  the  trainer  screen.  Accuracy  of  per¬ 
formance  was  determined  by  an  instructor  cr  observer  who  watched  the 
gunner  in  action.  To  provide  a  more  accurate  estimate  of  the  amount  and 
type  of  error,  the  instructor  had  a  switch  or  button  with  which  he  could 
project  a  reticle  upon  the  screen  at  the  aiming  point  of  the  gimner.  By 
visual  comparison  with  the  position  of  the  plane  image,  it  was  possible  to 
estimate  the  degree  and  direction  of  gunner  errors.  The  apparatus  and  . 


Table  10.4. — Correlations  between  ratings  ( Scale  4)  and  pound  school  pain 
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0.35 
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2.16 

-#.16 

23 

.43 
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1.31 

.20 

BiffffSw  . * . 

41 

.M 

3.46 
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1.33 
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36 

.47 

12.6* 

13.40 
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37 

.51 

11.20 

11.56 
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.57 

10.79 

11. *2 

2.4* 

.vt 

i i 

method  of  determining  error  were  different  for  B~17  and  B- 29  training, 
since  the  type  of  sighting  used  was  different.  The  Jam  Handy  equipment 
paralleled  hand  sighting  in  B-17  training  and,  in  B— 29  training,  it  was 
similar  to  the  computing  sight.  The  technical  details  would  require  ft 
lengthy  explanation  if  presented  here  and  are  regarded  as  beyond  the  scope 

of  this  report  •  '  ' 

In  B-17  and  B-24  training  each  gunner  was  given  at  least  three  formal 
tests  or  “phase  checks”  on  the  E-14  trainer  during  operational  training.  A 
test  or  phase  check  consisted  of  a  3-  to  4-minute  penod  on.  the  trainer 
during  which  an  instructor  observed  the  gunner’s  performance.  During 
each  period  the  instructor  made  a  total  of  10  observations  on  the  accuracy 
of  sighting.  The  score  for  each  observation  was  given  on  a  10-point  scaie, 
each  point  being  equal  to  1  “rad”  of  error.  Ten  was  to  be  a  perfect  score, 
and  zero  the  lowest  possible  sccre  which  represented  10  or  more  rads  o 
error.  The  scores  for  the  10  observations  added  together  formed  the  total 
test  or  phase  check  score.  Each  gunner  was  given  a  test  or  phase  check  as 
near  the  beginning  of  a  phase  of  training  as  possible. 

Prior  to  December  1944  all  gunners  were  supposed  to  hc/e  the  same 
amount  of  practice  on  the  Jam  Handy.  It  proved  to  be  very  difficult  to 
schedule  the  required  practice  sessions  for  all  >  nners.  Bet  mstruc  or? 
and  equipment  were  overloaded.  Hence,  in  Decen  oer  1944,  it  was  nee 
to  sp»  oc  QO  test  crore,  and  to  ex.  r°m  further  practice  m 

that  phase  of  training  all  gunners  equalling  ~r  exc-  mg  that  score  on 
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test  for  tbe  phase.  A  second  objective  was  to  improve  the  motivation  of  tic 
gunners  in  tbeir  practice  on  tbe  trainer.  In  this  connection,  it  is  Interest?^ 
to  note  tbe  increase  in  score  on  the  Jam  Handy  test  for  Phase  I  CsOowhy 
this  change  in  procedure.  The  pertinent  data  are  given  in  table  10.5. 

Tou  10J. — Sctrti  #■  tat  1  sj  tkt  Jam  Etmij  tnbm 


aiccs  mxn-B-ir  cuxveks— second  ajx  rcm.cz 


Tbe  reliability  of  Jam  Handy  test  scores  obtained  as  described  above  is 
illustrated  in  data  obtained  from  two  B-17  CCTS.  The  correlation  be¬ 
tween  test  I  and  test  2  for  Biggs  Held  and  the  average  in tercorr elation  ha 
fpMi  two  to  four  tests  for  Ardmore  are  given  in  table  10.6.  It  is  obvious 
that  these  scores  have  little  or  no  reliability. 


Tamlz  10j6.— j It&obSUy  cocfdaUs  of  Jt-JT  Jos*  Hondy  tat  scorn 
SECOND  AIK  FOKCX 


Not  only  did  the  B-29  crew  training  on  the  Jam  Handy  differ  from  that 
for  B-17  and  E-24  crews  in  apparatus  and  method  of  sighti-'v  W  tbe 
method  of  scoring  also  differed.  Little  attempt  was  made  to  -'.•cure  * 
numerical  estimate  of  the  degree  of  error  in  aiming.  Subjective  rating.'  yen. 
made  by  the  instructor  on  three  aspects  of  performance:  framing,  tracks^ 
and  burst  control.  Ten  observations  were  made  on  a  gunner  in  each  tew 
or  phase  check.  The  ratings  for  the  three  aspects  of  performance  were 
added  together  for  the  ten  observations  and  the  score  was  then  the  per¬ 
centage  which  this  value  was  of  the  maximum  possible  total  score.  Stu¬ 
dents  were  not  excused  from  training  on  the  basis  of  a  minimum  score  aed 
the  number  of  tests  given  varied  from  student  to  student.  In  a  group  ot 
B-29  gunners  at  Alamogordo  the  number  of  tests  ranged  from  two  to  nine. 
In  table  10.7  are  g’Ven  the  correlations  between  scores  achieved  on  odd  and 
even  tests.  Although  the  reliability  is  very  low,  there  is  some  evident  e  that 
,  with  a  larger  sample  of  performance,  z  higher  reliability  might  be  obtained. 
Tbe  fact  that  the  number  of  tests  -aried  may  have  made  these  values 
spuriously  high.  However,  no  more  CetaHed  analysis  was  believed  war¬ 
ranted  by  the  available  data. 

Data  on  the  Ji.ai  Handy  test  scores  were  obtained  f*_.u  one  CCTS  (H) 
class  where  the  ;.tandard  scoring  procedu/e  developed  at  the  Central  School 
for  Flexible  Gi’inery  at  Laiedo  AAF  w  s  used.  This  procedure -was  in 
process  of  beir.|  set  up  throughout  the  Second  Air  Force  at  the  close  of 

214 


x 


b«tilitie«.  The  main  points  of  difference  from  current  practices  were  • 
better  definition  of  errors  and  the  inclusion  in  each  test  of  20  instead  of  10 
observations.  Also  special  standardized  test  films  were  used.  In  table  104 
are  given  the  reliabilities  computed  within  tests  and  computed  between 
tests  for  each  of  the  gunners  of  the  crews.  As  might  be  expected  tbe  within 

Tabic  10.7-— ReliabXly  coefficients  of  B~29  Jem  Handy  test  tcont 
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test  reliabilities  are  high  while  the  correlation  between  test  scores  Is  tow. 
However,  it  should  be  noted  that  these  are  still  higher  than  those  obtained 
under  more  common  current  practice  where  the  procedures  were  less 
standardized.  • 


Table  10 X. — " eUabtlily  coefficients  of  Jons  Handy  test  scores 
LAREDO  ARMY  AIR  FIELD— SCORING  PROCEDURE 
Within- tat  reEsfcility,  three  tests  each  prener 
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Between-lest  reliability,  “a”  averse  ol  IntewnreUtioiw  of  three  tots 
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Gun  Camera  Scores 

As  with  the  scoring  of  trainer  performance,  scoring  of  gun  camera  mis¬ 
sions  varied  greatly  from  station  to  station  in  the  Second  Air  Force, 
great  deal  of  difficulty  was  present  at  first  in  securing  adequate  camera 
equipment.  Different  cameras  differed  somewhat  in  iheir  operation,  fre¬ 
quently  camera  malfunctions  prevented  the  obtai.  mg  of  ^assessable  films. 
One  common  practice  made  most  of  the  available  data  o.  doubtful  value. 
Because  of  the  difficulty  of  obtaining  sufficient  mis.  ns  to  meet  minimum 

215 


|  requirements  non-assessable  film  was  frequently  credited  toward  meetly 

these  requirements.  Since  no  distinction  was  made  between  film  that  was 
*  nonassessable  because  of  camera  or  other  unavoidable  malfunctions  and 


?  film  that  was  nonassessable  because  the  attacking  aircraft  did  not  appear 

In  it,  the  assessed  film  represented  a  rather  selected  sample  of  gunner  per¬ 
formance. 

The  scoring  procedures  used  were  very  different  for  hand  aimed  guns 
and  guns  with  computing  sights.  Scoring  of  film  obtained  with  hard  aimed 
guns  offered  tremendous  difficulties  and  it  is  doubtful  whether  the  scores 
bore  any  relation  to  probable  accuracy  of  shooting.  The  actual  score  given 
•  on  a  mission  was  a  sort  of  percent  hits  score,  based  on  a  subjective  judg¬ 
ment  by  an  observer  viewing  the  film  projected  on  a  screen.  The  person 
scoring  the  film  picked  out  what  he  thought  were  typical  frames  for  each 
attack  by  a  fighter  aircraft.  For  each  typical  frame  the  scorer  derided 
whether  the  reticle  of  the  gun  sight  was  correctly  placed  on  the  picture 
with  respect  to  the  attacking  aircraft.  If  the  sighting  was  judged  correct, 
the  frame  was  scored  as  a  hit.  If  incorrect,  it  was  scored  as  a  miss.  The 
judgment  required  of  the  scorer  was  exceedingly  complex  and,  as  regards 
true  likelihood  of  hitting  the  attacking  plane,  impossible.  Such  factors  as 
relative  speeds  and  directions  of  movement  of  attacking  and  attacked 
planes  were  not  represented  in  any  way  in  the  pictures  obtained.  About 
all  a  skilled  scorer  could  do  was  to  assume  typical  T>eed  and  direction  of 
movement  and  decide  whether  the  “lead”  given  in  sighing  was  reasonable. 

With  computing  sights  a  better  assessment  of  performance  possible. 
In  scoring  this  film  a  sample  of  the  frames  was  also  utilized,  tl-o  fact 
that  the  corrections  in  directKi  in  which  the  guns  actually  pointed  n 
automatic  and  the  gunners’  job  was  to  set  the  sight  directly  on  the  attack¬ 
ing  plane  made  scoring  a  much  more  simple  process).  This  sample  usually 
-  included  a  little  over  5  percent  of  the  frames  registering  the  pursuit  curve 
portion  of  the  attack.  The  frames  chosen  for  scoring  were  selected  by  the 
scorer  who  was  instructed  to  select  typical  frames  distributed  afxmt  evenly 
through  the  total  pursuit  curve  portion  of  the  attack.  Two  types  of  errors 
were  estimated  for  each  frame  scored.  A  tracking  error  was  obtained  by 
measuring  on  the  photograph  the  distance  from  the  center  of  the  reticle 
of  the  sight  to  the  center  of  the  v.'ng  section  of  the  fighter  plane.  A 
framing  error  was  scored  by  measuri  •  g  the  difference  between  the  width 
oi  the  wing  span  of  the  attacking  plai  ;  and  the  width  of  the  reticle.  The 
unit  of  measurement  in  each  case  wa;  one-eighth  “rad”  or  one-eighth  of 
the  radius  of  the  first  ring  on  the  35--.un.  sight.  After  determination  of 
the  two  types  of  error  on  each  frame,  thve  were  several  procedures  in  use 
to  determine  the  score  for  the  total  minion.  The  gun  camera  scores  ob¬ 
tained  at  the  different  stations  were  thus  o  pressed  in  terms  of  various  types 
of  units,  depending  upon  the  particular  pr.-.edure  in  use  at  those  stations. 

A  detailed  study  was  made  of  the  gun  cai  •  ?ra  records  for  one  'CCTS  (H) 
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f|m  at  Sioux  City.  Training  requirements  were  that  each  gunner  expott 
at  least  50  feet  of  film  on  each  of  4  missions.  z  IditJon,  the  navigator 
bombardier  also  exposed  some  film.  The  crews  completed  their  gmt- 
geiy  requirements  in  an  average  of  6  missions  per  crew.  Each  crew  ex¬ 
posed  an  average  of  30  units  of  50  feet  of  filn  (S.D.  of  3).  The  exposed 
film  represented  a  total  of  3,350  attacks.  The  number  of  fighter  attacks 
jas  .^tually  much  less  than  this,  since  a  single  attack  on  a  formation  of 
B-17  aircraft  might  be  filmed  by  15  or  20  gunnere.  As  far  as  gunners  were 
concerned  the  figure  of  3,350  represented  the  total  possible  number  of 
scores.  Of  these  only  645  were  scorable,  so  that  the  gun  camera  scores 
enured  represented  only  19  percent  of  the  gunnery  accomplished  by  this 
r|i,w  0f  b-17  crews.  In  table  10.9  are  given  the  reliabilities  of  the  gun 
camera  scores  for  this  class.  Within  and  between  mission  reliabilities  are 
given  for  both  hand  sights  and  computing  sights.  In  this  study  the  hand 


Tabix  10.9. — Reliability  coefficients  of  tun  camera  scores' 
B-J7  GUNNERS— SIOUX  CITY  AA3 — SECOND  AIR  FORCE 
•  Within  mission  reliability 


• 

Number 

O'. 

cases 

First  attack.  1 

Second  attack,  2j 

fit 

Mean 

S.D. 

Mean 

□ a 

112 

125 

129 

34.7 

2.02 

!.7f 

17.2 

.86 

.97 

37.1 

1.97 

1.68 

18.7 

.86 

1.10 

0.M 

.w 

Competing  sight*: 

129 

1.79 

.74 

1.69 

.71 

.  .81 

Between  mission  xellabtutjr 


Number 

of 

cases 

First  mission,  i 

Second  mission,  2 

f* 

Mean 

S.D. 

Mean 

pa 

31 

27 

3S.8 

1.66 

18.8 

.59 

41.8 

1.38 

17.6 

.58 

0.04 

.48 

BIGGS  FIELD 


• 

Number 

of 

casts 

Odd  missions,  / 

Even  missions,  t 

fa 

Mean 

Eg 

Mean 

S.D. 

210 

32.2 

4.92 

32.5 

; 

a. 05 

0.  IS 

Correlations  between  gun  camera  scores  and  rating  ot  film 


- - — - 

N« 

M. 

Mi 

P 

T 

t 

fw> 

204 

204 

205 

33.8 

33.0 

32.2 

31.6 

31.7 
31.7 

0.33 

if 

.57 

3.82 

3.82 

4.06 

0.36 

.22 

.07 

n_?o  GUNNERS— PYOTE  AAF 

“  '  | 

Number 

First: 

ion,  / 

Second  mission,  t  j 

fa 

of 

CISC* 

Mean 

S.  D. 

Mean 

~  151 

32.2 

1.92 

32.5 

5.04  j 

0.11 

t 


703330— 47— IS 


217 


sight  scores  were  as  described  previously  and  the  scores  for  the  compute 
sights  were  the  actual  error  scores  obtuned  for  the  separate  frames  scored. 
Ko  attempt  was  nude  here  to  use  the  routinely  reported  total  gun  camera 
score.  As  might  be  expected  the  within  mission  reliabilities  were  high  tad 
the  between  mission  reliabilities  were  low.  Reliability  between  mission 
was  practically  zero  for  the  hand  sights  but  was  appreciable  for  the  com. 
puting  sights.  The  small  numbers  of  cases  make  the  latter  result  open  tt 
question. 

Also  given  in  the  table  is  the  correlation  between  scores  on  odd  and  evta 
missions  for  210  B-17  gunners  at  Biggs  Field,  each  gunner  having  from  ? 
to  6  scored  missions.  In  obtaining  gun  camera  score  for  a  mission,  the 
average  tracking  and  average  framing  error  were  first  computed  for  al 
attacks  and  all  frames  scored  from  that  mission.  Then  the  equhmlent  nun- 
ber  of  hits  per  attack  was  read  from  a  standard  chart  prepared  for  this  pur. 
pose.  For  the  same  gunners  there  were  available  subjective  ratings  of 
consistency  of  tracking  and  iraming  and  of  presence  or  absence  of  sdf. 
inflicted  damage.  Correlations  between  these  subjective  ratings  and  avenge 
gun  camera  score  are  also  given  in  table  10.9.  Since  the  judgments  w ere 
two-category  ratings,  all  coefficients  are  biserial  in  form. 

The  reliability  of  gun  camera  scores  for  B-29  gunners  at  one  Second  Air 
Force  Station  is  also  shown  in  table  10.9.  The  procedure  for  obtaining  total 
gun  camera  score  at  this  ion  differed  from  that  described  for  the  B-17 
data  reported  above.  In  addition  to  the  determination  of  an  average  track¬ 
ing  and  framing  error  as  described  earlier,  a  third  error,  percent  of  framing 
error,  was  computed  by  dividing  the  framing  error  by  the  target  a 
fourth  score,  total  error  was  really  the  final  score  for  each  frame  and  was 
obtained  by  ravitiplying  the  percent  framing  error  by  SO  (except  that  in 
waist  position  the  factor  was  100)  and  adding  the  tracking  error.  The  total 
score  for  the -mission  was  then  100  less  the  average  of  the  scores  from  all 
frames  scored. 

Relation  Between  Trainer  and  Gun  Camera  Score* 

In  table  10.10  are  given  the  correlations  between  gun  camera  scores  on 
the  Jam  Handy  and  the  E-8  trainers.  The  E-8  (“Spotlight”)  trainer  had  a 
spot  of  light  moving  over  a  screen  in  an  erratic  pattern  and  the  task  of  the 
student  was  to  follow  the  spot  with  the  gun  sight.  When  the  sight  was 
properly  operated,  pressing  the  burst  control  switch  activated  counters 
which  recorded  two  scores;  number  of  shots  fired  and  number  of  shots  fired 
while  the  sight  was  on  the  target.  From  these  two  were  obtained  the  per¬ 
cent  hits  or  total  score.  Only  the  tracking  feature  of  gunnery  was  involved 
in  operation  of  this  trainer.  From  the  data  in  the  tabtej  the  E-8  trainer 
would  seem  to  have  a  greater  similarity  of  performance  to  aerial  gunnery 
than  the  Jam  Handy.  The  latter  was  selected  for  standard  use  at  all  sta¬ 
tions  primarily  because  E-8  equipment  was  difficult  to  standardize  and 
keep  in  adjustment 
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SUMMARY 

Since  the  primary  missions  of  research  personnel  in  the  Continental  Air 
Forces  were  related  to  the  validation  of  selection  and  classification  techni¬ 
ques  used  in  the  Training  Command,  little  research  was  done  in  flexible 
gunnery,  where  such  techniques  were  developed  too  late  for  use  in  valida¬ 
tion  studies.  The  research  that  was  accomplished  was  necessitated  l<y  an¬ 
other  mission  assigned  to  research  personnel,  also  late  in  the  war,  that  of 
establishing  procedures  for  the  designation  of  potential  lead  crews.  The 
studies  made  were  primarily  analyses  of  proficiency  measures  and  synthetic 
trainer  scores. 

The  results  presented  indicate  that  with  the  training  methods  in  effect 
at  the  time,  it  was  not  possible  for  instructors  to  make  reliable  ratings  of 
individual  gunners.  Ratings  of  the  gunners  of  a  crew  as  a  group  were  more 
reliably  made.  Ground  school  grades  were  moderately  reliable.  The  cor¬ 
relation  between  these  two  scores  was  negligible.  The  Jam  Handy  trainer, 
when  procedures  for  its  use  were  carefully  controlled,  provided  scores  of  low 
hut  statistically  significant  reliability.  Gun  camera  procedures  were  so 
varied  and  unstandardized  that  the  resulting  scores  were  of  doubtful  value. 
These  scores  had  almost  no  reliability  for  hand-sighted  guns;  for  com¬ 
puting  sights  their  reliability  was  low  but  significant.  The  E-8  trainer  pro¬ 
vided  scores  which  correlated  more  highly  with  gun  camera  scores  than  did 
those  fr^m  the  jam  Handy.  The  results  are  regarded  as  highly  tentative 
in  view  of  the  lov  reliability  of  the  variables  concerned. 
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CHAPTER  ELEVEN. 


Selection  and  Evaluation 
of  Lead  Crews 


INTRODUCTION 
The  Tactical  Importance  of  the  Lead  Crew 

Although  the  advent  of  the  atomic  bomb  may  well  change  all  tactic^ 
concepts  in  warfare,  prior  to  its  successful  operation  the  lead  crew  occupied 
a  peculiarly  important  place  in  bombing  operations.  Two  quotations  il¬ 
lustrate  tins  very  well  The  first  is  a  quotation  from  Manual  50-1,  20th  A* 
Force,  entitled.  Lead  Crew: 

“Experience  in  actual  combat  has  demonstrated  that  skillful  leadership  is  necessary  1 

compact  defensive  formation  Is  to  be  maintained  and  accurate,  concentrated  bombing  of 

targets  achieved.  Experience  has  shown  that  bombing  results  have  varied  with  the  dril 

and  experience  of  lead  teams.  .  To  place  a  high  percentage  of  the  bombs  of  aa 

entire  squadron  or  group  within  that  drde,  (within  500  feet  of  assigned  MPI),  is  noth 

ample  task,  but  one  which  involves  a  number  of  highly  developed  techniques.  .  .  TV 

burden  of  attaining  this  goal  rests  hugely  upon  lead  crews." 

• 

Major  General  Curtis  LeMay,  Commanding  General  of  the  XXI  Bomber 
Command,  states  in  the  Foreword  to  the  Lead  Crew  Manual  of  that  Com¬ 
mand: 

"The  mission  of  this  Command  is  to  destroy  enemy  targets.  -Since  our  effectiveness  h 
accomplishing  this  mission  must  be  measured  in  terms  of  our  best,  rather  than  our 
average,  capabilities,  selected  ‘Lead  Crews,’  representing  the  best  we  have,  will  lead  onr 
formations.  The  success  of  our  tactical  operations,  therefore,  will  depena  o  a  high  de¬ 
gree  on  Lead  Crew  proficiency.  In  no  other  military  operation  does  so  great  c  respon¬ 
sibility  devolve  on  so  small  a  group  of  specialists  as  in  the  case  of  Lead  Crews,  c'.iring 
the  brief  span  of  the  bombing  run,  all  of  the  human  life,  labor,  and  matiriel  that  f-'-t 
been  invested  in  placing  the  formation  over  the  target  are  held  ‘in  trust’  by  tbe  Lesc 
Crew,  whose  performance  determines  whether  or  not  the  investment  pays  off.” 

So  much  importance  was  attached  to  the  part  played  by  lead  crews  that 
special  training  was  given  crews  chosen  to  serve  in  this  capacity.  This 
training  was  given  at  lead  crew  schools  set  up  for  ‘his  propose  in  the  8th 
and  20th  Air  Forces.  In  other  Air  Forces  it  was  a  part  of  the  tactical 
training  given  to  organizations  assigned  to  them.  In  a  sense  thh  training 
represents  the  most  advanced  step  in  the  training  of  combat  crews. 

In  the  early  part  of  the  war,  as  doci.rines  were  developed  for  the  utiltf**  i 
tion  of  outstanding  crews  in  lead  position,  it  became  more  and  more  im¬ 
portant  to  identify  such  crews  early  in  their  tours  of  combat  duty.  It  was 
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*  obviously  impossible  to  try  out  every  crew  in  lead  position.  The  whole 
\  procedure  would  work  most  effectively  if  some  means  were  at  hand  to  desig¬ 
nee  the  most  likely  crews  at  the  start  of  combat  operations.  These  could 
I  then  be  watched  closely  and  when  they  had  the  necessary  experience  could 
!  tried  out  in  lead  position.  It  was  only  natural,  therefore,  that  com* 
panding  officers  receiving  replacements  in  the  theaters  of  operations  should 
!  desire  more  and  more  information  as  to  the  proficiency  of  these  crews.  Aft 
'  first  such  information  was  sent  sporadically  and  informally  in  inJosures 
to  base  records  sent  overseas.  Later  the  problem  was  recognized  officially  - 
1  plans  were  made  to  provide  routinely  the  needed  information. 


[  Job  Amdyria  ' " . 

The  duties  of  lead  crews  and  their  crew  members  included,  of  course,  all 
'  of  the  regular  duties  of  each  specialty  in  any  crew.  However,  some  of 
these  duties  were  much  more  important  in  a  lead  crew;  and  the  thorough¬ 
ness,  with  which  all  duties  were  performed  was  also  more  important.  In  the 
paragraphs  which  follow  some  of  the  important  aspects  of  the  duties  of 
lead  crews  are  touched  on  very  briefly.  A  much  more  detailed  presentation 
can  be  Obtained  from  Heavy  and  Very  Hearvy  Bombardment  Training 
fftintiafc  and  from  Manuals  of  Lead  Crew  Training. 

Since  the  lead  crew  started  all  parts  of  and  set  the  pace  for  the  bombing 
operation  for  all  of  the  crews,  the  first  step  in  the  preparation  of  lead  crews 
for  missions  was  obviously  mastery  by  the  crew  members  of  every  detail  of 
the  mission  plan.  Particularly  important  here  were  the  assembly  plan,  the 
signals  to  be  used,  details  of  course  decided  upon  to  avoid  flak  and  the 
directions  for  the  attack  upon  the  target.  As  with  all  crews,  a  thorough  pre¬ 
flight  inspection  by  the  airplane  commander  of  the  crew  and  its  equipment 
was  essential. 

On  the  mission  the  airplane  commander  had  to  make  certain  that  the 
lead  plane  flew  exactly  according  to  mission  S.O.P.  and  on  exactly  the 
briefed  course'  He  saw  to  it  that  his  own  group  maintained  a  close  com- 
pact  formation.  He  was  responsible  for  having  his  crew  monitor  the  VHF 
channel  at  all  rimes.  He  checked  frequently  with  the  navigator  as  to  prog-, 
ress  on  the  course.  At  the  IP  he  was  required  to  turn  the  riup  over  to  the 
bombardier  well-trimmed  and  with  the  autopilot  functioning  proper  y. 
After  the  bombing  run  be  had  to  so  regulate  the  return  flight  that  as  many 
as  possible  of  the  stragglers  couid  be  protected;  but  be  co  not  o  is  a 
the  expense  cf  the  proper  defensive  formation. 

The  lead  navigator  had  to  make  a  particularly  careful  preflight  check  of 
all  his  instruments.  He  had  to  go  over  the  entire  mission  with  the  crew, 
discussing  every  feature.  On  the  flight  he  had  to  hit  ^ac  contro  poin  on 
time.  Not  only  did  he  have  to  gauge  the  path  of  his  o.  t  plane  with  respect 
to  the  effects  of  wind,  speed  on  turns,  and  other  factors,  ne  a  0  ® 

into  account  the  flight  characteristics  of  whole  formation.  In  cooperation 
with  the  bombardier,  (and  radar  observer)  be  had  to  pm  mnt  the  position 
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of  the  plane  frequently  and  give  the  appropriate  information  to  the  airplay 
commander  from  time  to  time.  When  approaching  the  IP  the  navigator 
alerted  the  bombardier  and  cooperated  with  him  to  make  sure  that  the  Ip 
was  identified  early  and  certainly.  He  maintained  not  only  the  usual  navi, 
gation  logs  but  made  records  of  weather,  fighter  opposition,  antiaircraft 
fire  and  presence  of  friendly  or  hostile  aircraft  At  the  actual  bombing  rua 
be  made  a  record  of  all  possible  details  including  the  results  of  the  bombing 
He  had  to  be  prepared  to  take  evasive  action  when  passing  points  of  resist, 
ance.  Any  changes  in  plans  necessitated  by  delays  or  other  circumstances 
had  to  be  reported  to  the  airplane  commander  for  decision  as  to  action. 

The  radar  observer  alternated  the  main  coordination  of  his  activities  be¬ 
tween  navigator  and  bombardier.  On  the  flight  to  and  from  the  target  he 
maintained  a  plot  of  the  course  as  did  the  navigator.  He  assisted  in  direct* 
ing  the  lead  plane  and  the  formation  around  known  flak  areas  and  the  like. 
Much  of  his  work  was  an  independent  check  upon  that  of  the  navigator. 
On  over-water  flights,  depending  upon  the  presence  of  an  undercast,  the 
radar  observer  or  the  navigator  reported  to  the  other  the  moment  of  land¬ 
fall  and  the  ground  speed  at  the  time.  Except  to  report  and  check  with 
each  other,  the  radar  observer  and  navigator  worked  independently,  thus 
assuring  the  most  accurate  possible  navigation.  As  With  other  crew  mem¬ 
bers  a  careful  preflight  check  of  the  equipment  was  essential. 

The  bombardier  like  the  navigator  and  radar  observer  checked  all  his 
equipment,  including  bomb3,  fuses,  sight  and  bomb  bay  doors  prior  to  take¬ 
off.  He  also  set  his  altimeter  and  checked  his  interphone  position.  He  also 
briefed  the  crew  regarding  the  bomb  run  itself.  During  the  flight  to  the 
target  the  bombardier  set  up  as  much  of  the  information  as  possible  in  bis 
sight,  checking  such  items  as  temperatuit  and  wind  as  he  went  along.  He 
read  drift  from  his  sight  to  check  on  the  drift  obtained  by  the  vavigator 
He  kept  watch  for  friendly  and  enemy  fighters  and  c:,~cked  the  crew  on 
the  oxygen  equipment.  He  aided  the  pilot  in  setting  up  thu  .vitopvlot  He 
checked  and  rechecked  all  data  for  accuracy.  Prior  to  arrival  «.*  the  IP 
he  made  trial  runs,  if  possible,  to  check  the  set-up  of  computer  and  co¬ 
pilot  He  observed  the  terrain  over  enemy  territory.  Finally  he  cooperated 
with  navigator  and  radar  observer  in  locating  the  IP  and  then  the  target 
itself. 

Depending  upon  the  visibility  the  radar  observer  did  or  did  not  play  a 
large  part  in  the  bomb  run  itself.  If  there  was  any  difficulty  in  seeing  the  IP 
visually,  the  radar  observer  took  the  pilot  around  the  IP  on  the  turn  toward 
the  target.  The  bombardier  meanwhile  set  up  his  sight  at  the  direction  of 
the  radar  observer  as  if  he  were  bombing  visurj’y  so  that  he  could  take 
over  at  any  moment  if  the  target  came  into  view.  If  the  target  did  not 
appear  visually  he  set  the  sight  into  operation  as  if  it  had  happened,  using 
the  signal  of  the  radar  observer  and  data  supplied  by  him  fo?  its  operation. 
The  bombs  were  then  dropped  under  direction  of  the  latter. 

The  airplane  commander,  navigator,  bombardier  and  radar  observer 
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weft  frequently  referred  to  in  training  directives  and  in  conversation* 
jBjong  training  personnel  as  the  "bombing  team.”  However,  the  division  of 
duties  among  the  last  three  of  these  was,  in  actual  practice,  not  as  clearly 
defined  as  the  above  brief  description  might  imply.  Crew  doctrines  in¬ 
volving  radar  bombing  were  continually  being  developed  and  revised.  Thus 
tfcere  was  considerable  variation  from  crew  to  crew  as  to  which  member  of 
the  bombing  team  performed  a  particular  task.  For  example,  In  the  B-29 
aircraft  the  navigator  had  a  radar  scope  and  it  was  possible  for  him  to 
rcit*  the  turn  and  direct  the  bombing  run,  when  the  target  was  obscured. 
On  many  crews  the  navigator  actually  did  so.  Whether  the  bombardier, 
radar  observer  or  navigator  assumed  the  major  duties  on  the  bombing  run 
appeared  to  be  a  matter  worked  out  in  part  by  the  crew  involved.' 

The  radio  operator  contributed  far  more  to  the  efficiency  of  combat  crews 
in  general  and  lead  crews  in  particular  than  the  status  of  radio  operators 
would  indicate.  He  was  especially  important  in  lead  crews  since  all  com¬ 
munications  with  the  rest  of  the  formation,  with  other  formations  and 
with  appropriate  ground  stations  passed  through  him.  He  was  responsible 
for  the  proper  functioning  of  all  radio  equipment  and  had  to  see  that  sets 
were  tuned  and  operating  properly  at  take-off.  He  checked  spare  fuses  and 
tubes.  The  radio  operator  also  usually  inspected  guns  and  other  equipment 
Where  possible  during  the  mission  he  attempted  to  code  messages  ahead  of 
time  so  that  no  time  would  be  lost  in  sending  when  the  signal  was  given. 

The  final  crew  member  of  special  importance  for  the  lead  crew  was  the 
tafl-gunner.  In  many  lead  crews  this  was  an  officer— usually  a  copilot  or  a 
gunnery  officer.  Whether  officer  or  enlisted  man,  he  had  to  have  a  thor¬ 
ough  knowledge  of  formation  SOP  and  tactical  doctrines  as  it  was  his  job 
to  report  to  the  airplane  commander  the  conduct  of  the  formation  behind 
the  lead  plane.  His  position  was  particularly  important  during  assembly 
when  he  reported  tne  positions  of  the  various  units  in  sight 


Job  Specifications 

The  qualities  necessary  for  success  in  !eai  crew  position  were  given 
considerable  study.  Information  regarding  them  was  obtained  from  a  num¬ 
ber  of  sources.  Aviation  psychologists  in  each  of  the  Continent*  Air 
Forces  interviewed  officers  with  combat  experience,  espec  y  experience 

in  lead  crew  position.  In  the  Fourth  Air  Force  instructors  a  e 

School  at  Muroc  Army  Air  Field,  Muroc,  Calif,  were  interviewed. ^Addi¬ 
tional  information  was  obtained  from  training  manua  ,  manua 
crew  training,  from  study  of  intelligence  reports  and  from ^  published 
analyses  of  combat  operations.  An  attempt  was  made 
interviews  in  the  Second  Air  Force,  to  obtain  traits  and  cha  ac  emti« 
r  •  ,  vi.  Although  n  ost  of  the  characteristics 

referring  to  the  crews  as  a i  whole. A>“°  8  „tmbers,  a  (e„  character- 

menhoned  obviously  referred  to  panic  -  ’  given  considerable 

istics  and  traits  referrable  to  the  total  ere 

emphasis. 
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Tbe  Instructors  at  the  Lead  Crew  School  at  Murcc  were  in  general  agree, 
ment  that  the  Ideal  lead  crew  wi-  composed  of  men,  all  of  whom  were  tj. 
cepticnal  In  their  respective  assignments.  Expertness  on  the  part  of  all 
personnel  was  not  regarded  as  sufficient,  however.  Regarded  as  of  equal 
Importance  was  demonstration  of  an  unusual  amount  of  teamwork  and  co¬ 
operation  on  the  part  of  individual  crew  members.  A  crew  of  independent, 
noncooperating  experts  would  not  be  regarded  as  a  good  lead  crew.  The 
typical  manner  in  which,  as  a  group,  the  instructors  determined  whether 
or  not  a  crew  was  likely  to  be  a  lead  crew,  provides  insight  into  their  coo. 
ception  of  the  lead  crew.  They  determined  first  whether  each  member  of 
the  crew  possessed  the  fundamental  skills  of  his  aircrew  postion  to  a  marked 
extent.  Tney  then  evaluated  the  amount  and  quality  of  the  teamwork  and 
coordination  demonstrated  by  the  crew.  The  relationships  between  pilot 
and  flight  engineer,  pilot  and  navigator,  and  among  the  navigator,  bom¬ 
bardier  and  radar  observer  were  regarded  as  particularly  important  The 
presence  of  an  average  or  even  a  weak  aircrew  member  would  tend  to  be 
overlooked  if  the  teamwork  exhibited  by  the  crew  as  a  whole  was  extremely 
good. 

Lead  crew  personnel  interviewed  in  the  Second  Air  Force  agreed  very 
well  with  the  instructors  at  Muroc  as  to  the  most  important  characteristics 
for  success  as  a  lead  crew.  Outstanding  proficiency  in  each  specialty  Was 
regarded  as  of  major  importance.  Also,  as  at  Muroc,  cooperation  and  team¬ 
work  were  considered  nearly  as  important.  Certain  additional  characteristics 
were  both  frequently  mentioned  and  given  great  weight  in  these  interviews. 
The  first  of  these  was  combat  experience.  It  was  felt  that  a  good  lead  crew 
should  have  successfully  met  a  wide  range  of  combat  conditions:  heavy 
flak,  fighter  opposition,  exhaustion  of  gas,  high  altitude,  poor  visibility, 
bad  weather  and  equipment  malfunctions.  In  a  sense  such  a  crew  might  be 
said  to  have  proven  itself  and  would  thereby  be  better  suited  for  lead  posi¬ 
tion  than  an  untried  crew. 

Another  important  characteristic  was  eagerness  and  enthusiasm.  This 
was  thought  to  involve  a  combination  of  strong  desire  to  destroy  the  enemy 
and  active  enjoyment  of  the  job  of  lead  postition.  The  eager  lead  crew 
was  thought  of  as  one  that  ilew  extra  missions,  worked  extra  hours  on 
trainers,  studied  briefing  materials  and  learned  each  other’s  jobs.  Related 
to  this  trait  or  characteristic  were  confidence,  both  in  the  airplane  com¬ 
mander  and  in  the  crew  as  a  crew,  and  pride  in  crew  acu-mplishments. 

A  third  quality  considered  important  was  crew  discipline,  in  *be  weD 
disciplined  crew  individual  crew  members  wer*  not  unduly  familiar  oth 
the  airplane  commander.  They  were  always  on  time  at  formations  ano 
rerely  had  absences.  They  did  not  argue  with  each  other  over  decisions 
made.  Orders  were  obeyed  without  repetition.  Crew  members  remained 
calm  and  worked  smoothly  and  efficiently  regardless  of  the  situation.  Inter¬ 
phone  discipline  was  thought  especially  important.  On  the  one  hand  there 
was  no  jabbering  of  useless  material  over  the  interphone  and  the  other 


land  the  ahplaoe  commanda  was  kept  informed  oI  ^  rrfnU 

sod  crew  members  checked  frequently  on  each  other 
rmaHy,  leadership,  especially  0f  the  airplane  cormrider  was  considered 
important  A  crew  m  which  other  crews  hid  confidence  was  sometimes 
considered  a  better  bet  for  lead  crew  than  more  able  crews  lacking  such 
confidence.  A  good  lead  crew  had  few  complaints  from  other  crews  In  the 
formation  after  missions  were  over.  Because  of  the  presage  it  gives,  rank 
«as  mentioned  as  desirable  is  the  lead  crew. 

The  characteristics  or  qualities  of  individual  crew  members  thought  espe¬ 
cially  important  for  a  lead  crew  are  given  in  table  11.1.  The  table  Is  a 
composite  of  material  obtdned  in  all  three  of  the  Continental  Air  Forces 
dealing  with  bombardment  crews.  No  attempt  is  made  to  present  the 
individual  characteristics  in  order  of  importance  since  adequate  information 
of  this  sort  was  not  obtained  in  any  Air  Force.  The  one  exception  is  profi¬ 
ciency  in  the  individual  specialty.  This  was  clearly  considered  the  most 
important  single  characteristic  for  each  aircrew  position  in  the  lead  crew. 
Because  it  applied  to  evay  crew  position  it  is  stated  here  and  does  not  ap^ 
pear  in  the  table  under  the  individual  specialties.  It  should,  however,  be 
understood  that  under  each  pecialty  this  is  the  most  important  item. 


Tabi.e  11.x  . Qualities  important  v>  lead  crews 


Airplane  commander: 

Formation  flying: 

Knowledge. 

Foresight. 

Smoothness  of  control 
Experience  in  combat 
Ability  to  plan  ahead. 

Skill  in  instrument  flying. 

Perceptual  judgment 
Interest  in  crew. 

Rank. 

Enthusiasm  for  the  job. 

CJn  ness  in  emergencies. 

Leadership. 

Copilot:  . 

Formation  flying: 

Foresight 

Smoothness  of  controL 
Instrument  flying  skill. 

Cooperation  with  airplane  commander. 
Navigator: 

Skill  in  celestial  navigation. 

Skill  in  dead  reckoning  navigation 
Complete  accuracy  in  pin-point  naviga¬ 
tion. 

Knowledge  of  formation  flying. 

Foresight 

Thoroughness  in  routine  procedures. 

Good  cooperation  with  crew. 


Bombardier: 

Skill  in  dead  reckoning  navigation. 
Consistency  of  bombing. 

Foresight 

Good  target  identification. 

Stability  under  stress. 

Enthusiasm  for  the  job. 

Good  cooperation  with  others. 

Flight  Engineer: 

Ability  to  meet  changes  in  plans. 
Accuracy  in  routine  computations.  - 
Skill  in  estimating. 

Ability  to  handle  crew. 

Radar  observer: 

Skill  in  interpreting  instruments. 

Ability  to  make  fine  adjustments  of  in¬ 
struments. 

Proficiency  in  navigation. 

Good  cooperation  with  crew. 

Radio  operator: 

Skill  in  sending  and  receiving. 

Skill  in  adjustment  of  equipment. 
Gunners: 

Skill  in  j”dging  distance  and  rate  of 
movement. 

Tboroughnc.'  of  preflight  procedures. 
Cooperation  with  rest  of  crew. 


225 


Aseemhlj  «f  Potential  Lfd  Crews 

The  ne?J  far  providing  overseas  air  forces  with  information  about 
proficiency  of  the  crews  being  assigned  taere  was  officially  recognised  wj*J 
the  publication  of  AAF  Letter  50-1 17,  7  Jose  1945.  This  letter  went  err* 
further,  however,  also  specified  procedures  fa'  the  assignment  ct 
individuals  to  crews  prior  to  operational  training  in  m  attempt  to  obtain 
the  MMTtmpfn  possible  number  of  outstanding  crews.  According  to  the  pn- 
visions  of  letter,  personnel  were  assigned  to  crews  at  the  AAF  Combat 
Crew  Processing  ;»nd  Distribution  Center  in  the  AAF'  Training  Command 
on  the  basis  of  a  lead  crew  aptitude  score.  This  score  was  based  on  erala*- 
tioa  of  aerial  training  ^nd  experience,  on  written  examinations  and  a* 
original  aptitude  scores.  Individuals  with  the  highest  lead  crew  aptitude 
were  assigned  tot-ether  on  crews  and  such  crews  were  tentatively  designated 
potential  lead  crews.  At  the  end  oi  operational  training  the  letter  provided 
tint  the  organization  in  which  training  was  done  would  review  the  desig¬ 
nations  of  the  crews  and  either  confirm  cr  revise  the  lead  cteir  designations 
for  crews  so  de-ignated  prior  to  the  training.  This  information  was  then  to 
be  sent  overseas  with  the  crews  concerned.  An  appropriate  form  was  pro¬ 
vided  for  the  transmission  of  the  necessary  information  from  the  AAF 
Training  Command  through  operational  training  to  overseas  commanders. 
The  end  of  the  war  made  the  carrying  out  of  these  procedures  unnecessary. 
For  d-ttaHs  of  the  previsions  for  crew  assembly  and  the  records  to  be  used 
see  AAF  Letter  50-117,  a  copy  of  which  is  included  in  the  appendix  H.1. 

Problems  in  Crew  Evaluation 

The  concept  of  the  team  and  emphasis  on  team  spirit  have  been  fcr 
years  an  important  part  of  the  social  pattern  in  the  United  States.  They  ‘ 
find  ez.  resskwi  at  nearly  all  levels  of  society;  in  schools,  in  business,  a 
gangs  and  dubs,  etc.  It  was  only  natural  that  emphasis  on  teamwork 
should  appear  at  many  places  in  the  armed  forces.  Probably  teamwork 
and  team  spirit  were  nowhere  more  emphasized  than  in  the  combat  crews 
of  the  AAF.  This  emphasis  began  at  the  highest  levels  of  command  where 
publidty  releases,  recruiting  drives,  training  polities  and  the  like  had  their 
origin  and  extended  down  to  the  training  organizations  where  the  concept 
of  the  team  was  utilized  to  build  morale  and  motivate  individuals  and  crews 
in  training  for  combat.  One  of  the  main  reasons  given  for  the  sweeping 
changes  in  procedures  for  crew  assembly  which  were  directed  in  AAF  Let¬ 
ter  50-117  was  the  belief  that  previous  practices  for  assembling  lead  crews 
resulted  in  ‘"breaking  up  the  integrity  of  the  combat  crew”  by  taking 
individuals  from  separate  crews  and  recombining  them  during  their  tour  of 
combat  duty.  Whatever  the  ultimate  eval  iation  of  this  emphasis,  there  is 
no  doubt  that  the  crew  was  quite  generally  treated  as  if  it  had  a  character 
-  quite  apart  from  the  individual  characteristics  of  its  members. 

In  attempting  to  evaluate  the  performance  of  the  crew  a3  a  whole,  one 
immediately  meets  an  interesting  and  important  problem  in  Social  pr  Group 
Psychology.  The  fundamental  question  is:  Are  the  characteristics  of  * 

226 


■nun  1  wrr 


r0cp  of  individuals,  such  as  a  combat  crew,  completely  explained  by  sum* 
up  the  individual  characteristics  of  its  members?  From  the  official 
ezphisis  upoo  crew  integrity,  from  interviews  with  returnees  and  the  Hke 
it  would  seem  that  there  is  widespread  belief  that  the  crew  as  a  whole  does 
pr&er.i  characteristics  not  observable  in  the  individual  crew  members. 
Tgffftrer,  there  were  many  with  the  opposite  viewpoint  who  maintained 
&it  the  ooe  important  thing  in  assembling  a  lead  crew  was  to  obtain 
frgvidual  crew  members  that  were  of  outstanding  ability  in  their  specialties. 
Father  evidence  here  was  the  fact  that  it  was  extremely  difficult  to  obtain 
^scnptio&s  of  crew  characteristics,  most  of  the  suggested  characteristics 
of  good  lead  crews  being  stated  in  terms  of  characteristics  of  various  fit* 
(Evidual  crew  members.  Any  evidence  that  might  be  obtained  in  studies  of 
oew  proficiency  which  could  throw  light  on  this  problem  would  be  of  great 
jjportauce  for  all  branches  of  soda!  science.  It  would  also  have  important 
snpfieations  for  general  Air  Forces  policy. 

It  was  of  course  difficult  to  obtain  any  direct  evaluation  of  Lad  crews  as 
soch  in  operational  training  since  few  crews  were  given  an  opportunity  to 
stive  in  true  lead  capacity.  Furthermore,  from  the  description  in  previous 
1  paragraphs  it  can  be  seen  that  most  of  the  cbaracteristi-  s  thought  important 
m  lead  crews  could  be  measured  objectively  only  with  great  difficulty.  Thus 

•  research  personnel  attempting  to  make  evaluation  of  potential  lead  crew 
proficiency  were  forced  to  fall  back  upon  subjective  judgments.  Finally, 

'  the  importance  attributed  by  all  concerned  to  over-all  proficiency  of  both 
’  individual  and  crew  made  any  measures  or  observations  of  crew  proficiency 
‘  pertinent  to  evaluation  cf  lead  crew  proficiency. 

CRITERIA  OP  CREW  PROFICIENCY 
Measures  of  Bombing  Accuracy 

In  a  sense,  the  bombing  accuracy  of  a  crew  has  an  inherent  validity  not 
possessed  by  any  other  criterion  of  crew  proficiency,  for  the  accurate  bomb-  - 
ing  of  enemy  targets  is  the  oitimate  objective  of  all  bombardment  opera 
Sons.  Two  main  type'  »i  evidence  were  available  in  operational  training 
relative  to  the  bonding  accuracy  of  all  types  of  bombardment  crews.  These 
were  the  ere-,  average  circular  errors,  obtained  from  observations  of  prac¬ 
tice  bom'. -3  dropped  on  circular  targets  at  bombing  ranges,  and  the  records 
of  r/Iar  and  camera  bombing  of  industrial  targets  where  no  bom  s  were 
f  '-.ually  released.  In  heavy  bombardment  training  greater  emp  aas  was 
I  placed  on  the  former  type  of  operation  and  in  very  heavy  bom  ar  ment 

•  training  the  emphasis  was  more  on  the  latter  type.  Since  ra  er  eren 
!  problems  were  encountered  in  studies  of  proficiency  in  the  two  types  o 
■  operations,  they  are  discussed  separately  in  the  paragraphs  w  l  o  aw. 

e  Vi:ual  Bombing  on  Bombing  Ranges 

”  A  number  of  studies  were  made  in  the  Continental  Ai  Forces  of  average 
circular  error  in  operational  training.  The  procedures  Hinanly  used  in 
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obtaining  and  recording  average  circular  error  in  operational  training  dif. 
fered  little  from  those  used  in  Bombardier  Schools  in  the  AAF  Training 
Command.  In  general,  there  were  the  same  sources  of  error  and  the  re¬ 
liability  of  this  measure  was  low,  being  approximately  O.SO.  However 
this  value  is  considerably  higher  than  such  values  obtained  in  the  AAP 
Training  Command  where  they  were  frequently  not  significantly  different 
from  zero.  Thit  difference  reflects  a  fundamental  difference  in  procedure 
in  that  in  the  Training  Command  the  pilot  varied  from  mission  to  mission 
while  in  operational  training  the  same  crew  and  pilot  flew  with  a  bom¬ 
bardier  throughout.  Studies  of  bombing  errors  in  the  Training  Command 
had  shown  that  the  pilot  contributed  about  as  much  to  bombing  accuracy 
as  did  the  bombardier.  The  combined  effect  of  pilot  and  bombardier  in 
operational  training  would  thus  be  expected  to  produce  a  bombing  error 
score  of  higher  reliability  than  that  in  the  AAF  Training  Command,  as  was 
actually  found.  The  Training  Command  data  do  not  permit  of  a  sufficiently 
fine  analysis  of  variance  to  determine  whether  or  not  the  observed  reliability 
in  operational  training  was  actually  any  different  from  what  would  be  ex¬ 
pected  from  a  combination  of  the  contribution  of  pilot  and  bombardier. 
Near  the  end  of  hostilities  attempts  were  in  progress  to  remove  some  of  the 
sources  of  error  in  current  practices  by  the  installation  of  sonic  scoring 
equipment  and  procedures.  However,  no  data  with  the  new  procedures 
were  ever  obtained.  For  a  more  detailed  analysis  of  circular  error  see 
chapter  7,  Bombardier. 

The  most  important  criticism  of  average  circular  error  as  a  criterion  of 
crew  proficiency  was  neither  the  lack  of  reliability  nor  the  prevalence  of 
sources  of  error  in  obtaining  it.  It  was  »the  criticism  that  the  bombing 
procedures  involved  so  little  of  the  procedures  used  in  combat  operations. 
Average  circular  error  was  obtained  from  bombs  dropped  at  target  ranges. 
Hence  the  target  location  and  appearance  were  well  known  to  the  crew. 
There  were  no  problems  of  identification  of  target  or  IP.  Frequently  sev¬ 
eral  runs  were  made  in  succession  over  the  same  target,  and  one  or  more 
practice  runs  were  often  made  prior  to  dropping  bombs  for  record  purposes. 

Simulated  Bombing  of  Industrial  Targets 

For  these  reasons  the  main  emphasis  in  training  shifted  to  procedures 
paralleling  combat  operations  more  closely,  namely  those  involving  long 
range  flights  to  industrial  areas  where  a  bombing  run  was  made  upon  a 
target  seen  by  the  crew  from  the  air  for  the  first  time.  The  chief  problem  in 
this  type  of  train1  og  has  been  to  obtain  an  accurate  scoring  of  the  bombing 
run. 

Two  main  typrs  of  scoring  of  these  bombing  runs  were  developed.  The 
first  and  most  c.  mmor.ly  used  was  camera  scoring.  There  were  a  number 
of  camera  scor'-ig  systems  but  in  general  the  te  hniques  involved  a  suc¬ 
cession  of  pictvres  taken  on  \he  approach,  at  the  moment  of  hypothetical 
bomb  release  and  perhaps  a  picture  or  two  thereafter.  By  obtaining  in 
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each  photograph  the  point  on  the  ground  representing  the  true  vertical 
from  plane  to  ground  it  was  possible  to  plot  the  flight  path  of  the  plane. 

If  the  interval  of  time  between  the  photographs  was  accurately  determined 
jt  was  even  possible  to  obtain  from  the  photographs  the  ground  speed  of  the 
plane  and  its  altitude.  The  probable  point  of  impact  was  then  estimated 
and  the  circular  error  from  the  intended  target  determined.  In  practice  a 
great  many  difficulties  were  encountered  in  the  use  of  this  method.  But  for 
some  time  it  remained  the  only  feasible  method  of  scoring  such  bombing 
practice. 

With  the  development  of  accurate  radar  ranging  and  directional  equip-  * 
naent,  it  became  possible  to  obtain  a  completely  objective  record  of  the 
flight  paths  of  planes  approaching  industrial  areas  where  such  installations 
had  been  set  up.  Headquarters,  Army  Air  Forces  therefore  initiated  Project 
5S4,  Radar  Bomb  Scoring,  to  score  all  bombing  runs  on  industrial  targets 
by  crews  in  training  in  the  Continental  Air  Forces.  Installations  were  not 
completed  at  the  close  of  training  so  that  very  few  data  from  this  method 
of  scoring  are  available. 

Since  detailed  statistical  data  on  both  visual  and  radar  bombing  scores 

I  are  presented  in  the  discussion  of  average  circular  error  in  chapter  7,  The 
Bombardier,  none  will  be  presented  here.  In  general,  radar  bombing  scores 
showed  moderate  reliability  and  from  that  standpoint  were  regarded  as  ade¬ 
quate  for  use  as  criteria  in  validation  studies.  In  addition  to  moderate  re¬ 
liability,  bombing  scores,  especially  those  obtained  in  VHB  training  from- 
simulated  bombing  of  industrial  targets  were  believed  to  have  special  value 
as  a  measure  of  crew  proficiency.  It  has  already  been  pointed  out  in  dis¬ 
cussions  of  the  use  of  bombing  scores  as  criteria  of  proficiency  for  various 
different  specialists,  such  as  the  pilot,  bombardier,  navigator  and  radar 
observer,  that  the  performance  of  several  crew  members  affected  the  bomb¬ 
ing  score  as  well  as  the  proficiency  of  the  specialist  in  question.  As  a  result; 
the  bombing  scores  were  not  highly  regarded  as  measures  of  individual  pro¬ 
ficiency.  For  precisely  this  reason,  however,  bombing  scores  might  be  re¬ 
garded  as  good  measures  of  crew  proficiency.  While  it  may  not  be  possible 
to  determine  the  relative  contributions  of  the  different  crew  members,  the 
bombing  error  score  probably  represents  the  best  available  measure  of  the 
'">mbined  efforts  of  the  crew  as  a  whole. 

Rating  Technique* 

|  Data  on  potential  lead  crew  proficiency  were  obtained  in  the  Continental 
Air  Forces  with  three  different  rating  scales.  Two  of  these,  Scale  A  and 
‘  Scale  B,  were  developed  in  the  16th  and  17th  Bombardment  Training 
!  Wings  of  the  Second  Air  Force,  while  the  third  was  developed  by  instructor 

Personnel  in  the  Lead  Crew  School  at  Muroc  Ar  ’y  Air  Field  with  the 

[j  distance  of  aviation  psychologists  in  the  Fourth  Ai»  borcc.  Scales  A  and 

B  attempted  to  obtain  an  over-all  judgment  from  t!  '  observer  as  to  the 

S  amount  or  degree  to  which  certain  traits  and  charactei  ics  were  present  in 
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the  individual  being  rated.  The  scale  developed  in  the  Fourth  Air  Force 
w.is  designed  to  rate  student  performance  on  a  particular  mission  on  varum 
aspects  of  his  job.  With  the  Second  Air  Force  scales,  each  crew 
would  be  rated  only  once,  near  the  end  of  training.  With  the  Fourth  Ah 
Force  scale  each  individual  and  crew  would  be  rated  on  each  of  severe 
missions.  The  rating  procedures  in  the  Second  and  Fourth  Air  Forces  were 
thus  very  different  even  though  some  of  the  traits  to  be  rated  were  similar. 

The  details  of  procedure  used  in  constructing  and  administering  Scales 
A  and  B  in  the  Second  Air  Force  are  described  in  chapter  4,  Airplane  Com¬ 
mander,  in  the  subsection  on  ratings.  In  addition  to  items  referring  to  each 
aircrew  officer  and  to  the  gunners  of  the  crew  as  a  group,  a  number  of  items 
in  each  scale  referred  to  characteristics  of  the  crew  as  a  whole.  Scale  A 
contained  six  such  items  requiring  ratings  of  the  following:  (1)  Interphone 
Procedure  (2)  Crew  Discipline  (3)  Calmness  in  Emergencies  (4)  Prefligh 
Procedures  (5)  Eagerness  and  Enthusiasm  and  (6)  Potential  Lead  Crew 
Proficiency.  Scale  B  contained  eight  items  including:  (1)  Potential  *fad 
Crew  Proficiency  (2)  Preflight  Procedures  (3)  Eagerness  and  Enthusiasm 
(4)  Interphone  Discipline  (5)  Foresight  and  Planning  (6)  Teamwori 
(7)  Crew  Discipline  and  (8)  Ranking  in  Proficiency  (among  other  crews 
of  the  class).  In  addition,  with  Scale  B  confidential  judgments  were  ob¬ 
tained  from  each  airplane  commander  as  to  the  five  best -and  five  poorest 
crews  in  his  class.  In  table  11.2  are  given  the  distributions  of  ratings  oa 
each  item  referring  to  the  total  crew  for  both  Scale  A  and  Scale  B.  Also 
given  are  the  distributions  of  the  total  ratings  on  all  the  crew  items  for  each 
scale.  Note  that  with  Scale  B  all  crews  were  not  rated  on  all  items. 

With  both  Scale  A  and  Scale  B  independent  ratings  from  two  or  more 
observers  were  obtained  wherever  possible  at  each  of  the  stations  whae 
ratings  were  made.  The  reliabilities  of  such  ratings  are  shown  by  the  cor¬ 
relation  between  independent  ratings  of  the  same  crews.  These  arc  given 

Table  lli. — Distributions  of  ratings  on  items  referring  to  the  crew  as  o  wfc-J* 
16th  AND  I7lh  WINGS— SECOND  AIR  FORCE  1 


‘Two  raters.  160  crews. 
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in  table  11-3  for  each  of  the  items  of  the  scales.  Coefficients  were  competed 
separately  for  each  class  or  squadron  rated.  These  were  then  averaged  by 
Fisher's  weighted  *  method  to  give  the  coefficients  listed  in  the  table.  In 
table  11.4  are  presented  the  reliabilities  of  the  total  scores  for  both 
ya ]ps,  based  on  all  items.  Separate  coefficients  are  given  for  each  station 
and  for  all  stations  combined.  It  is  clear  that  the  reliabilities  of  the  crew 
ratings  were  considerably  higher  for  Scale  B  than  fo.*  Scale  A.  It  is  also 
interesting  that  there  is  a  fair  correlation  between  the  standard  deviation 
of  the  ratings  and  the  reliability,  the  lowest  standard  deviation  for  Scale 
B  being  higher  than  the  highest  for  Scale  A.  From  the  distributions  of  the 
total  ratings  on  all  crew  items  in  table  11.2  it  is  apparent  that  there  is  a 

Tablx  1  i  J.— Reliabilities  of  independent  ratinp  of  drew  prcfickncj 

16th  AND  »7th  WINGS— SECOND  AIR  FORCE  ■ _ 
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good  range  of  scores  for  the  crew  scales  as  a  whole.  Evidently  the  i*. 
structors  did  make  some  discrimination  between  the  potential  lead 
proficiencies  of  the  different  crews,  although  the  basis  of  discriminate 
may  have  been  spurious  or  irrelevant. 

The  reliability  of  the  ratings  for  each  different  aircrew  specialty  rat^ 
are  given  in  table  1 1  -5  for  Scales  A  and  B.  The  coefficients  are  in  caek 
case  based  on  the  combined  ratings  on  all  items  of  the  specialty.  The 
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differences  in  reliability  between  Scale  A  and  Scale  B  are  not  as  marked 
in  the  case  of  the  separate  specialties  as  they  are  in  the  case  of  the  ratings 
of  the  crew  as  a  whole.  In  general,  the  scales  show  moderate  reliability  far 
all  positions.  It  Is  interesting  that  the  navigator  and  bombardier  rating, 
which  have  the  lowest  reliability  in  Scale  B  have  the  highest  reliability  is 
Scale  A.  It  is  probable  that  further  study  of  the  wording  of  the  items  ca 
these  scales  would  reveal  the  reasons  for  this  outcome;  ho v ever  cessation 
of  training  prevented  further  investigation  of  this  sort. 


Tabu  11.5. — Correlations  between  independent  ralinis 
16th  AND  17th  WINGS— SECOND  AIR  FORCE 
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Item  reliabilities  foe  Scale  A  in  all  specialties  ranged  from  0.07  to  0.73 
with  a  median  coefficient  of  0.36  (N  of  160).  For  Scale  B  the  coefficients 
ranged  from  0.16  to  0.66  with  a  median  of  0.41.  (The  number  of  cases 
per  item  varied  in  the  case  of  Scale  B  from  52  to  151).  There  were  dif¬ 
ferences  between  bases  as  to  the  reliability  with  which  items  were  rated 
and  considerable  variation  in  reliability  from  item  to  item  at  a  single  base. 
The  only  general  conclusion  that  seems  warranted  from  the  study  of  item 
refiabOties  is  that  instructors  showed  greater  agreement  among  themselves 
when  rating  students  on  general  over-all  items  than  when  making  ratings 
oo  specific  items  of  behavior.  The  average  coefficients  of  reliability  for 
over-all  or  general  items  were  0.46  and  0.53  while  those  for  the  more 
specific  items  were  0.38  and  0.42  for  Scales  A  and  B  respectively.  In 
other  words,  instructors  were  more  likely  to  agree  that  Student  A  was  a 
good  lead  crew  prospect  than  that  he  was  good  at  his  preflight  check. 

All  scales  for  all  aircrew  positions  showed  high  intercorrdations  of  items. 
This  fact,  taken  together  with  the  higher  reliability  of  over-all  items,  in¬ 
dicates  that  there  was  considerable  halo  effect  in  the  ratings  on  all  scales. 

The  ratings  cl  the  crew  were  generally  made  by  the  same  instructor  who 
rated  the  airplane  commander.  As  might  be  expected  the  ratings  of  the 
cew,  in  the  case  of  both  scales,  showed  a  high  correlation  with  the  rat¬ 
ings  of  the  airplane  commander.  Apparently,  the  instructor’s  rating  of  the 
crew  was  strongly  influenced  by  his  rating  of  the  airplane  commander.  The 
appropriate  correlations  are  giyen  in  table  11.6.  All  coefficients  in  the  table 
represent  the  weighted  z  average  of  separate  coefficients  for  each  class  and 
station. 

The  sum  of  the  ratings  of  the  crew  as  a  whole  showed  only  a  low  degree 
oi  correlation  with  the  ratings  given  individuals  other  than  the  airplane 
commander.  There  was  evidence  of  some  correlation  between  ratings  of 
copilots  and  navigators  and  crew  ratings  while  the  ratings  of  gunners  were 
least  related  to  the  ratings  of  the  total  crew. 


Tabix  1 1 .6. — Correlations  between  total  score  on  crew  scale  and  total 
score  for  each  specialty  seals 


Specialty 


Sole  A: 

l.  Airplane  comnander. 

3.  Copilot . . 

•J.  Navigator . 

4.  Bombardier . 

5.  Flight  engineer . 

4.  Radar  observer . 

7.  Gunner* . 

Scale  B: 

AiipUue  commander. 

3.  Copilot . 

3-  Navigator . . 

4.  Bombardier . 

x  engineer . 

*•  Radar  observer . 

7.  Radio  operator . 

*■  Gunner* . 


N 

C  -nr  scale,  / 

Individual 
<cale, ! 

Mean 

EES 

Mean 

S.D. 

160 

27.36 

5.77 

M 

5.28 

160 

27.36 

5.77 

Hall 

3.99 

160 

27.36 

5.77 

21.67 

4.37 

160 

27.35 

S.  77 

16.1* 

4.33 

160 

27.35 

5.77 

15.33 

5.32 

160 

27.36 

5.77 

20.35 

4.77 

160 

27.36 

5.77 

11.27 

2.45 

192 

3*  21 

11.40 

34.50 

10.76 

IS* 

38.10 

11.48 

jHEJ 

S.56 

<85 

38..’ 

11.44 

25.78 

7.8* 

186 

3S.O- 

1 1,44 

36.14 

9.  it 

186 

Eld 

1.36 

35.98 

9.91 

123 

36.14 

It. 72 

26.26 

7.4* 

37.88 

KW51 

23.58 

6.56 

190 

38.  IS 

11.36 

25.66 

6.4* 

TO 


.33 

.3* 


703330 — A7 — 35 


233 


The  crew  ratings  obtained  from  the  Lead  Crew  School  at  Muroc  Amy 
Air  Field  in  the  Fourth  Air  Force  included  ratings  of  three  types.  FU*, 
each  crew  member  was  rated  on  6  to  10  specific  items  on  each  mission  that 
was  rated.  Second,  each  crew  member  was  rated  on  over-all  proficiency  <* 
each  mission.  Finally,  each  crew  was  given  an  over-ail  rating  as  a  potential 
lead  crew  on  each  mission.  In  table  1 1.7  are  given  the  reliabilities  of  the 
Individual  item  and  over-all  ratings.  In  obtaining  these  reliabilities  an 
unweighted  average  individual  rating  was  obtained  from  the  item  -ratings. 
Then  for  all  three  types  of  ratings  odd-even  mission  correlations  were 
computed  separately  for  each  sample  of  crews.  These  coefficients  were  then 
corrected  by  the  Spearman-Brown  formula  and  the  weighted  average  of  the 
corrected  coefficients  for  three  classes  at  the  school  were  obtained.  The 
latter  form  the  data  included  in  the  table.  The  over-all  ratings  of  radar  ob¬ 
server  and  crew  and  the  average  individual  item  ratings  of  the  radar  ob¬ 
server  have  a  high  degree  of  reliability.  In  general  the  other  reliabilities 
are  moderately  high  and  roughly  comparable  to  those  obtained  in  the  Sec¬ 
ond  Air  Force.  One  marked  difference  was  in  the  navigator  ratings  which 
were  considerably  less  reliable  in  the  Fourth  Air  Force  data.  It  is  known 
that  administrative  difficulties  were  adversely  affecting  the  reliability  of  the 
navigator  rating  situation  at  Muroc  and  the  significance  of  this  result  is 
not  clear  from  the  data  at  hand.  Distribution  statistics  are  not  presented 
since  in  all  computations  the  ratings  were  converted  to  standard  scores  with 
a  mean  of  50  and  a  standard  deviation  of  10. 


Tabu  II. 7. — Reliabilities  of  mission  ratings  of  B-29  lead  crews 
LEAD  CREW  SCHOOL,  MUROC,  FOURTH  AIR  FORCE 


Potitioa 
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Crew  Proficiency  Greek 

The  Crew  Proficiency  Check  (VKB)  developed  in  the  Third  Air  Fore 
represented  a  somewhat  different  approach  to  proficiency  measurement 
The  purpose  of  the  instrument  was  to  obtain  as  objective  a  measure  as 
possible  of  over-all  crew  proficiency.  Surveys  of  measures  of  crew  profi¬ 
ciency  had  revealed  none  that  were  reliable.  It  was,  therefore,  deemed 
necessary  to  construct  a  special  instrument  for  the  purpose.  Findings  of 
previous  research  formed  the  basis  of  much  of  the  developmental  work. 
Most  of  the  background  material  was  taken  from  studies  on  the  qualifica¬ 
tions  of  an  airplane  commander  and  evaluation  of  airplane  commnder 
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ib3ity  In  CCTS  training  done  in  the  Third  Air  Force.  These  'todies  are 
presented  in  detail  in  chapter  4,  Airplane  Commander.  Ia  these  studies 
Inscriptions  of  combat  situations  in  which  airplane  commander  ability  was 
jxhibited  were  analyzed  to  obtain  information  on  the  qualifications  of  sue-  . 
ctssful  airplane  commanders.  Research  personnel  then  flew  with  student 
cjeWi  on  nearly  all  of  the  required  missions  in  CCTS  training  keeping 
jogs  on  each  mission,  in  which  record  was  made  of  all  observed  aspects  of 
briefing,  preflight,  flight,  and  post  flight  activities  of  airplane  commander 
and  crew.  These  logs  were  analyzed  to  determine  those  areas  or  activities 
where  airplane  commander  ability  was  manifested  and  where  measurement 
could  be  introduced. 

During  these  studies  it  was  also  possible  to  obtain  information  on  the 
extent  to  which  the  airplane  commander  contributed  to  the  proficiency  of 
the  crew  as  a  whole.  Since  the  airplane  commander  was  the  individual 
around  whom  all  crew  activities  revolved,  since  he  was  largely  responsible 
for  much  of  the  training  of  the  crew,  and  since  he  was  immediate  superior 
officer  of  all  crew  members,  it  was  not  surprising  to  observe  that  the  profi-  • 
dency  of  the  individual  airplane  commander  was  reflected  to  a  large  extent 

in  the  proficiency  of  the  crew  as  a  whole.  ' 

From  analyses  of  qualifications  of  airplane  commanders  obtained  from 
combat  situations,  from  analyses  of  flight  logs,  and  from  general  observa¬ 
tions  and  discussions  with  supervisory  and  instructor  personnel,  an  airplane 
commander  check  list  was  constructed.  Developmental  work  was  carried 
on  until  the  program  for  the  selection  of  potential  lead  crews  was  in-  . 
augurated.  Because  of  the  relationship  between  airplane  commander  abikty 
and  over-all  crew  proficiency,  the  airplane  commander  check  was  modified 
to  become  a  crew  proficiency  check  tor  ,ery  heavy  bombardment  crews. 
Airplane  commander  items  which  did  not  contribute  to  over-all  crew  profi- 
dency  were  dropped  and  items  reflecting  proficiency  of  other  crew  members, 

iniracrew  relations  and  cooperation  were  introduced.  ' 

The  Crew  Proficiency  Check  (VHB;  B-29)  in  its  final  form  consisted, 
of  a  crew  history  cover-page  and  S3  items  arranged  in  sequence  to  foflow 
the  logical  progression  of  a  mission  from  briefing  to  cntique.  * 
arrangement  was  made  to  facilitate  the  administration  of  the  check :  tat 
since  it  had  to  be  done  during  the  mission.  Areas  covered  by  the  riem 
were:  General  Proficiency;  Discipline,  Air  and  Groun  ,  n 
tion,  and  Crew  Compatibility.  The  items  were  largely  of  th 
choice,  descriptive-objective  type.  Each  item  dealt  with  an  area  of ^behavior 
or  with  specific  acts  of  crew  members  with  the  mu  ip  e*  .  s 

being  the  possible  reactions  or  ways  of  meeting  the  problem  involved.  Some 

items  involved  general  over-all  ratings  of  crew  or  crew  Barks- 

A  preliminary  torn,  of  the  check  was  administers  to  40 ,  w  at  Barks-. 

dale  Field  in  July  1945.  From  an  analysis  of  this  mi '  ^  1J0 

I  refinements  were  introduced  and I  the i  final ^  form  was  .  ^  ^  chcck  „„ 
crews  in  training  at  four  Third  Air  Force 
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administered  to  all  crews  with  whom  an  instructor  pilot  rode  during  the 
period  5*15  August  1945  regardless  of  mission  or  phase  of  training.  Two 
scoring  formulas  were  devel  )ped.  One  assigned  weights  to  alternatives  ac¬ 
cording  to  judgments  cf  “goodness”  or  “poorness”  of  the  alternative  re- 
sponses,  determined  in  conferences  with  training  personnel  and  from  study 
of  training  directives  and  the  like.  A  more  refined  scoring  procedure  yielded 
scores  that  correlated  0.94  ce  more  with  the  method  described  and  it  mu. 
therefore,  discarded. 

In  table  11.8  are  given  the  means  and  standard  deviations  of  scores  ob¬ 
tained  at  each  station  and  the  same  data  for  the  total  group  of  130  crews. 
Cessation  of  hostilities  and  the  subsequent  curtailment  of  tracing  pr*. 
vented  the  collection  of  sufficient  data  for  determining  the  reliability  of  the 
Crew  Proficiency  Check  (VHB). 

Tabu  il£.— Scores  on  ere w  proficiency  check  {VIIB;  B-29) 

B-29 — THIRD  AIR  FORCE 


Sutkm 
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Number 
of  crew* 

Maui 

»CX>re 

ID. 
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7.20 

l~t 

35 

31  Ak 

5-7 

25 
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t  27 

,  ,  ,  ,  T  .  . . f . . . 

i-t 

19 

33.26 

7  M 

D* . 

8-10 

18 

34.  *3 

t  74 

lbAAU . 

1-10 

26 

32.96 

7  14 

Total  - . . . I . 

130 

uTsT 

7.« 

Rate  of  Mission  and  Training  Accomplishment 

Another  type  of  criterion  which  initially  appeared  to  be  promising  was 
the  efficiency  and  dispatch  with  which  crews  attacked  and  completed  their 
training  requirements.  Various  training  accomplishment  scores  were  studied 
by  research  personnel.  For  detailed  discussion  of  this  type  of  criterion  i.id 
attempts  to  measure  its  reliability  see  chapter  4,  Airplane  Commander. 

In  one  of  the  studies  Second  Air  Force  research  personnel  obtained  cer¬ 
tain  accomplishment-of-training  scores  for  all  crews  on  each  of  fou.-  classes 
(VH)  for  whom  rating  scale  scores  had  been  obtained  for  all  crew  person¬ 
nel.  Two  training  accomplishment  scores  were  arrived  at  for  eac.u  ere#. 
One  score  was  a  measure  of  the  number  of  Second  Air  Force  trail  .'ng  re¬ 
quirements  that  had  been  completed  at  'he  end  of  a  given  period  of  coin¬ 
ing  while  the  other  was  based  on  the  number  of  Army  Air  Forces  Trainni 
Standard  requirements  completed.  In  the  case  of  both  scores,  a  mission 
requirement  flown  but  not  completed  was  counted  as  one  point.  When a 
mission  or  requirement  was  completed  it  was  counted  as  two  points.  It  was 
found  that  the  degree  of  correlation  between  the  two  measures  of  training 
accomplishment  was  quite  high,  as  might  be  expected.  At  the  end  of  6 
weeks  of  training  the  coefficient  was  0.83  for  170  crews.  At  12  and  1* 
weeks  the  &  measures  correlated  0.82  and  0.74  respectively,  based  on  data 
from  90  crews. 

The  advantages  and  disadvantages  of  this  type  of  criterion  are  discussed 
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st  length  in  chapter  4,  Airplane  Commander.  It  will  suffice  here  to  repeat 
that  no  satisfactory  measure  of  reliability  is  available  for  this  criterion 
and  it  is  known  to  have  been  influenced  by  a  large  number  of  variable 
factors  for  which  controls  are  difficult  if  not  impossible.  Crew  accomplish¬ 
ment  scores  apparently  had  some  degree  of  reliability,  but  not  much  more 
can  be  said  with  certainty. 

Oew  Awards 

Several  stations  in  the  various  air  forces  made  an  attempt  to  reward 
crews  that  did  an  outstanding  job  during  training.  The  rewards  took  various 
forms.  In  some  cases  rather  valuable  prizes  were  given.  At  several  stations 
winning  crews  were  given  the  privilege  of  flying  to  the  home  dty  of  some 
crew  member  on  a  short  leave  or  furlough.  In  other  cases  the  honor  of  the 
citation  was  considered  sufficient  reward.  Research  personnel  felt  that  the 
selection  of  outstanding  crews  for  these  awards  might  provide  a  criterion  of 
proficiency  that  would  be  useful  in  validation  and  lead  crew  studies. 

Examination  of  the  award  procedures  indicated  that  crew  awards  had 
little  value  as  a  criterion  of  crew  proficiency.  For  example,  at  one  station 
in  the  Second  Air  Force,  one  crew  was  chosen  each  week  as  the  “Crevr 
of  the  Week.”  Over-all  ratings  made  by  training  personnel  of  the  individual 
officers  of  four  successive  crews  of  the  week  were  examined.  Two  of  these 
crews  had  officers  with  very  high  ratings.  In  the  case  of  the  other  two, 
several  of  the  officers  had  almost  the  lowest  possible  ratings.  Inquiry  re¬ 
vealed  that  the  Director  of  Training  thought  that  these  crews  needed  a 
"shot  in  the  arm”  to  improve  their  morale.  Hence  he  had  had  them  desig¬ 
nated  as  crew  of  the  week. 

At  one  station  a  fairly  standard  procedure  had  been  set  up  to  determine 
the  ten  most  successful  crews  in  training  to  whom  awards  would  be  made  at 
the  end  of  training.  Since  records  used  in  this  determination  had  been  kept 
on  file  for  several  recent  classes,  a  more  detailed  study  of  this  criterion  was 
undertaken.  The  scores  entering  into  the  crew  award  score  together  with 
the  intercorrelations  between  them  are  shown  in  table  11.9.  The  award 
score  was  obtained  simply  by  adding  together  all  of  the  other  scores.  From 
the  intercorrelations  it  can  be  sera  that  the  Military  Training  Grade  deter¬ 
mined  to  a  large  measure  what  the  award  score  of  the  crew  would  be.  This 
is  due  to  the  fact  that  the  Military  Training  Grade  had  a  considerably 
larger  spread  of  scores  than  any  other  measure.  Also  given  in  the  table  aie 
the  correlations  between  the  various  grades  and  scores  at  the  end  of  the  first 
half  of  training  and  those  for  the  totai  training  period.  These  coefficients 
are  spuriously  high  since  the  first  half  scores  were  combined  with  second 
half  scores  to  obtain  the  total  score. 

&  ssioa  Failures 

Comments  on  the  unsatisfactory  performance  of  cemin  crews  sometimes 
included  references  to  a  tendency  to  return  from  f  g'nts  .  out  accutnp  .s 
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Intereorrdatioiu  of  Criteria 

Table  11.10,  51.11,  11.12,  and  11.13  present  data  that  were  obtvoef 
showing  the  relationships  between  various  measures  of  crew  pro6denc> 
First  of  all,  ratings  of  the  crew  as  a  whole  on  various  rating  scales  showed 
no  relationship  either  to  practice  or  radar  bombing  scores.  Since  tie  ratings 
and  the  bombing  scores  both  showed  moderate  reliability  this  roilt  scf 
gests  that  there  was  real  independence  in  the  two  measures.  It  shot-M  be 
pointed  out  in  this  connection  that  the  instructors  making  the  ratings  ot  cs; 
crew  as  a  whole  did  not  consult  the  bombing  scores  and,  at  least  in  the  case 
of  radar  bombing  scores,  did  npt  have  access  to  them.  Similar  evidence  b 
found  in  the  fact  that  the  correlation  between  crew  accomplishment  cf 
training  at  the  end  of  6  weeks  and  the  practice  bombing  average  axdar 
error  of  the  bombardier  was  0.01  for  974  crews  (B-17  and  B-24)  in  the 

Second  Air  Force.  .  , 

On  both  Second  Air  Force  Descriptive  Rating  Scales  crew  ratings  sbowtfl 
only  a  slight  relationship  to  crew  progress  as  indicated  by  the  number® 
training  requirements  completed  at  a  given  stage  of  training.  This  *** 
true  for  both  of  the  training  accomplishment  scores:  number  of  missions 
completed  and  AAF  Standards  completed. 
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VALIDATION  OF  INDIVIDUAL  STANINES  AGAINST  CREW 

CRITERIA 

Average  Circular  Error  v 

For  data  on  the  relation  between  the  stanines  of  individual  crew  meobeu 
and  the  average  circular  error  of  the  crew,  see  Chapter  4  through  10.  Ii 
general,  very  low  or  aero  correlation  was  found.  The  interpretation  of  this 
lack  of*  relationship  has  varied,  depending  on  the  specialty  concerned.  Ii 
some  cases,  there  might  well  be  no  relationship  between  the  stanine  of  the 
specialist  and  bombing  scores.  (In  other  cases,  a  possible  relationship 
might  have  been  obscured  by  the  fact  that  neither  of  the  scores  is  com¬ 
pletely  reliable). 


Crew  Ratings 

The  augmented  pilot  stanines  of  73  airplane  commanders  in  the  16th 
Wing  of  the  Second  Air  Force  correlated  0.11  with  the  rating  of  the  crew. 
In  the  case  of  Scale  B  (17th  Wing),  coefficients  were  0.08,  —0.08  and 
0.04  for  the  bombardier,  navigator  and  augmented  pilot  stanines  of  86  air¬ 
plane  commanders.  Ratings  of  the  crew  were  not  compared  with  the 
stanines  of  the  other  aircrew  specialists. , 


Crew  Awards 

The  correlation  between  stanines  of  various  crew  members  and  certaii 
scores  used  in  making  crew  awards  are  given  in  table  11.14.  Norn*  of  the 
correlations  is  significantly  greater  than  zero. 


Tabu  11.14. — Correlations  between  stanines  and  crew  award  scores 
SECOND  AIE  FORCE 


Type  of 


Airplane  commander's  pilot  stanine  against: 

Crew  award  score* . *  • 

Crew  academic  average . 

Crew  flying  average . 

Crew  military  . . 

Crew  attitude  ratine. 


_ r  award  score* 

Crew  attitude  ratine  _ 
Navigator’s  navieator  ttarune 

Crew  award  acore* . 

Crew  attitude  retina. . . 
Bombardier’s  bombardier 

Crew  award  score* . 

Crew  attitude  ratine. . . 
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ranis  were  converted  to  standard  scores  with  a  mean  of  50  and  SJD.  cl  JO. 


Rate  of  Training  Accomplishment* 

Data  on  the  relation  b  tween  training  requirements  completed  at  6  wee*> 
and  stanines  of  various  crew  members  are  given  in  chapters  4  through  10- 
Airplane  commander  stanines  were  found  to  correlate  significantly  with 
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training  accomplishment  scores.  None  of  the  stanines  of  other  crew  mem¬ 
bers  were  related  significant!}’  to  training  accomplishment. 


validation  of  combinations  of  stanines  against 

MEASURES  OF  CREW  PROFICIENCY 

Introduction 

Many  of  the  criteria  discussed  earlier  in  this  chapter  reflect  the  ability 
of  several,  and  in  some  cases,  of  most  of  the  members  of  the  crew.  It 
seemed  worthwhile,  therefore,  to  determine  whether  a  score,  representing 
more  or  less  the  average  aptitude  score  of  the  crew  members  was  related  to 
these  measures  of  proficiency.  A  number  of  such  comparisons  were  made  by 
research  personnel  in  the  Second  Air  Force.  Since  stanines  were  not  avail¬ 
able  for  all  of  the  commissioned  personnel,  it  was  necessary  to  make  sepa¬ 
rate  studies  with  a  number  of  different  groups;  i.e.,  a  group  of  crews  with 
stanines  for  4  specialties,  crews  with  stanines  for  5  specialties,  and  crews 
with  stanines  for  all  aircrew  officers.  In  all  studies,  the  augmented  pilot 
stanine  was  used  for  both  airplane  commander  and  copilot.  For  the  flight 
engineer  the  nonaugmented  pilot  stanine  was  used.  For  the  other  aircrew 
positions  the  appropriate  stanine  was  used:  N  stanine  for  navigator,  B 
stanine  for  bombardier  and  N  stanine  for  radar  observer. 


Crew  Rating* 

The  correlations  between  the  average  stanines  of  crew  members  and  rat¬ 
ings  of  the  crew  as  a  whole  on  both  scales  are  shown  in  table  11.15.  In 


TABiy  11.15 .—Correlations  between  average  crew  stanines  and  total 
score  on  crew  rating  scales 

16th  AND  17th  WINGS— SECOND  AIR  FORCE  _ 
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scores  on  all  the  individual  raling  “dau,  combining  both  rat- 

crew  rating.  Extensive  work  was  done _w  ^  comblnat.OM  dem. 

ing  scores  and  stanines  in  several  diffcren  ) 


Stanine,  I 

Meats 

S.D. 

6.97 

55 

6.83 

54 

6.88 

59 

6.86 

54 

7.27 

0.92 

6.86 

1.02 

6.60 

0.63 

6.89 

0.62 

6.91 

0.CS 

Crew  rating,  2 

rm 

Mean 

S.D. 

29.23 

4.86 

0.07 

27.61 

5.43 

-.03 

24.22 

5.10 

.23 

27.11 

5.64 

>.04 

36.02 

11.08 

.20 

38.46 

'2.40 

-.«« 

35.06 

10.72 

-.09 

42.62 

9.68 

.13 

38.14 

11.40 

>.01 

241 


onsirated  the  same  lack  of  relationship  as  is  shows  Is  tables  11.15  mJ 
11.16. 


Tabu  11.16  Correlations  between  iterate  crew  stanines  end  Mel  of 
I  scores  o]  all  individual  rating  scales 
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Crew  Awards 

There  was  in  general  little  relationship  between  crew  average  stanine  and 
scores  used  in  making  crew  awards  at  Gowen  Field  in  the  Second  Air  Force, 
as  is  evident  from  table  11.17.  However,  two  of  the  coefficients  are  signifi¬ 
cant  at  the  5- percent  leveL  In  this  connection,  it  should  be  pointed  out 
that  the  attitude  rating  and  average  academic  grade  were  highly  correlated 
and  both  scores  represent  much  the  same  accomplishment  As  with  validity 
studies  of  individual  stanines,  there  was  some  prediction  of  academic  suc¬ 
cess  by  the  stanines. 


Tabu  \\. 17. —Correlations  between  crew  average  stanines  and  crew  award  scores 
_ GOWEN  HELD-SECOND  AIR  FORCE 
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Training  Accomplishment 

The  correlations  between  various  types  of  training  accomplishment  scores 
and  crew  average  stanines  are  given  in  table  11.18.  Although  two  of  the 
correlation  coefficients  are  significant  with  the  large  number  of  crews  in¬ 
volved,  there  is  little  evidence  of  a  practical  degree  of  relationship.  The 
stanines  of  the  airplane  commander  showed  a  much  higher  degioc  of  re¬ 
lationship  to  this  criterion  than  does  the  crew  average  stanine.  It  would 

seem  that  the  rest  of  the  crew  played  a  small  part  in  connection  with  this- 
criterion. 
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RELATIONS  BETWEEN  PROFICIENCY  OF  DIFFERENT  CREW 

MEMBERS 

Assembly  of  crews  in  the  Continental  Air  Forces  was  done  for  the  most 
part  with  regard  only  to  military  occupational  specialty  and  certain  ad¬ 
ministrative  requirements.  Some  attention  was  paid  to  relative  ages,  ranks 
and  the  like,  but  little  or  no  effort  was  made  to  equate  crew  members  in 
terms  of  proficiency.  It  would,  therefore,  be  logical  to  assume  that  at  the 
outset  of  operational  training  there  is  only  a  chance  relation  between  the 
proficiency  of  the  different  crew  members.  However,  the  hypothesis  has  oc¬ 
casionally  been  advanced  that  in  the  process  of  living  and  working  together 
crews  tend  to  become  increasingly  homogeneous  in  many  ways,  even  with 
respect  to  proficiency.  A  number  of  studies  were  made  to  test  this 
hypothesis. 

In  the  Fourth  Air  Force  three  classes  of  heavy  bombardment  crews  from 
three  stations  were  studied  to  see  what  relationships  there  were  between 
the  available  proficiency  measures  for  different  crew  members.  The  avail¬ 
able  measures  of  proficiency  were  converted  to  standard  scores  and  the 
intercorrelations  among  the  measures  for  the  fc  r  aircrew  officers  deter¬ 
mined.  These  are  given  in  table  11.19  for  the  1+0  crews  studied.  Also 
shown  are  the  mean  and  standard  deviations  of  tl  •  intercorrelations  and 
the  mean  ir.tcrcorrelations  for  each  station  for  each  fhre^  types  of  profi- 
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ckacy  measures.  TV  n*aa  intercorrelalions  of  synthetic  Uxmer  scores 
,~f  jroood  school  trades  are  approximately  aero  while  those  obtained  ior 
jo^xuclors*  ratings  are  positive  and  significantly  different  from  zero.  7h» 
resdt  might  indicate  that  there  was  some  homogeneity  within  crews  al¬ 
though  other  types  of  measures  do  not  support  this  view.  On  the  other 
Kirnt  the  result  might  indicate  the  presence  of  a  halo  effect,  *-*-»  the  i*. 
dividuab  of  the  crews  were  rated  in  conformity  with  a  general  impress** 
made  by  ooe  or  more  of  the  crew  members. 
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The  correlations  between  rankings  of  different  crew  memben  by  Second 
Air  Force  instructors  are  given  in  table  11.20.  A  total  of  li  CCTS  (H) 
rlac<^  are  represented  in  the  data.  Except  for  the  high  coneu.*’ons  be¬ 
tween  the  rank  given  pilots  and  copilots  the  correlations  between  vVmgs 
of  different  crew  members  are  low.  The  similarity  in  ranking  of  pilot  «.vl 


Tablk  11.20. — Inter  correlations  among  rankings  of  different  crew  members 
11  B-17  AND  B-24  CCTS  CLASSES— SECOND  AIR  FORC* _ 
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copOot  is  probably  due  to  the  fact  that  the  latter  were  not  well  knows  to 
the  instructors.  Such  correlations  as  were  here  obtained  can  probably  best 
be  explained  as  due  to  a  generalized  halo  effect  in  the  minds  of  the  raters. 
In  fact,  in  view  of  the  emphasis  on  total  crew  in  operational  training,  these 
correlations  are  surprisingly  km. 

The  intercorrelations  between  the  scores  used  in  making  crew  awards 
for  different  crew  members  are  listed  in  table  HJ1.  As  in  the  studies  is 
the  Fourth  Air  Force  there  is  little  evidence  of  homogeneity  of  proficiency 
within  crews  except  when  ratings  are  used  as  the  measure  of  that 
proficiency. 

T «nz  11-21  - — J x irrcorrelai ions  of  crem  award  secret  0 /  different  arm  members 
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Intercorrelations  of  the  over-all  and  average  ratings  of  individuals  and 
the  rating  of  the  crew,  in  the  case  of  the  Muroc  scales,  provide  some  in¬ 
sight  into  the  relative  contributions  of  the  various  specialists  crew  profi¬ 
ciency  (at  least  insofar  as  crew  proficiency  was  measured  by  the  rating  of 
the  crew).  In  contrast  to  the  crew  ratings  in  the  Second  Air  Force,  at  the 
Lead  Crew  School  every  instructor  rated  the  crew  as  a  wbole,  regardless  of 
his  specialty.  In  the  crew  over-all  rating,  therefore,  were  represented,  in 
about  equal  proportions  the  ratings  of  the  crew  by  instructors  in  all  sp®- 
cialties  except  flight  engineer  and  gunnery  instructors.  Examination  of  the 
coefficients  in  table  11.22  indicate  that  the  ratings  of  the  pilot,  navigator 
and  radar  observer  were  a  little  more  closely  related  to  the  ratings  of  the 
crew  than  were  the  ratings  of  the  bombardiers.  Since  this  was  a  school  for 

Table  11.22. — Correlations  of  individual  rating  scores  with  rating 
of  crew  and  with  radar  ACE 
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bombing,  it  is  interesting  that  the  bombardier  contributed  so  little.  On  the 
other  hand,  it  is  not  surprising  that  the  ratings  of  flight  engineer  were  not 
related  to  over-all  crew  rating  since  flight  engineer  instructors  did  not  par. 
ticipate  in  the  ratings  of  the  crew. 

Examination  of  the  correlation  of  the  individual  ratings  with  radar  aver¬ 
age  circular  error  scores,  also  shown  in  table  11.22  suggests  that  the  per¬ 
formance  of  these  two  specialists  as  measured  by  the  rating  scale  was 
somewhat  more  closely  related  to  crew  performance  as  measured  by  the 
bombing  score  than  was  the  case  for  the  other  aircrew  positions. 

THE  RELATIONSHIP  BETWEEN  INTERESTS  AND  MEASURES 
OF  LEAD  CREW  PROFICIENCY 

Although  it  was  recognized  as  important,  this  problem  was  not  ex¬ 
haustively  studied  by  research  personnel  due  to  the  cessation  of  training  at 
the  end  of  the  war.  However,  some  preliminary  studies  were  carried  0IL 
Since  being  a  member  of  a  lead  crew  involved  certain  hazards  and  rtvpoa- 
sibflities  in  addition  to  certain  rewards  in  the  way  of  prestige,  it  ^ 
reported  by  training  officials  that  not  all  individuals  were  interested  in 
being  a  member  of  a  lead  crew.  Hence  it  was  believed  that  the  interest  of 
individuals  in  the  crew  in  being  part  of  a  lead  crew  would  have  sow*  bear¬ 
ing  on  the  efficiency  with  which  they  carried  on  their  duties  and  the  i  wnner 
in  which  the  crew  as  a  whole  performed. 

Research  was  done  in  this  area  in  both  the  1 6th  and  17th  Wings  o'  q* 
Second  Air  Force  with  the  descriptive  rating  scales  that  were  descn.vt 
earlier.  In  the  16th  Wing  each  individual  was  asked  to  indicate  his  strength 
of  interest  in  being  a  member  of  a  lead  crew  and  his  appraisal  of  the 
amount  of  his  crew’s  interest  in  being  a  lead  crew,  and  several  other  ques¬ 
tions  varying  slightly  in  approach  and  wording  to  determine  the  strength 
of  interest  in  lead  crew  membership.  In  the  17th  Wing,  the  airplane  eom- 
'  mander  was  asked  to  estimate  his  crew’s  desire  for  a  lead  assignment  asd 
each  crew  member  was  requested  to  indicate  bis  interest  in  being  a  mv&et 
of  a  lead  crew. 

In  the  16th  Wing  the  correlation  between  the  sum  of  the  interests  :.f  a2 
crew  members  in  being  members  of  a  lead  crew  and  the  ratings  of  the  \\vcw 
as  a  potential  lead  crew  was  low  (0.31)  but  significantly  different  frfc* 
zero.  This  was  obtained  for  156  crews  in  the  16th  Wmg.  For  this  same 
group,  the  correlation  between  the  individual’s  interest  in  lead  crew  and  ** 
his  rating  as  potential  lead  crew  material  was  not  different  hom  zero  for 
airplane  commanders,  copilots,  bombardiers  and  navigator?.  Low  but 
significant  correlations  were  found  for  radar  observers  and  flight  t'.-ineers. 
pactiy  the  same  result  was  obtained  when  the  interests  of  the  indivicvsls 
in  having  their  crew  be  a  lead. crew  were  correlated  with  their  rating 
potential  lead  crew  specialists. 

As  might  be  expected  there  was  a  high  correlation  in  the  case  of  all  air¬ 
crew  posit 'ons  between  the  strength  of  the  individual’s  desire  for  le*d  crew 
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duty  and  bis  estimate  of  the  strength  of  the  desire  of  the  crew  for  that  duty. 
•This  might  be  due  to  an  actual  relationship  or  to  the  fact  that  *fce  individual 
projected  his  desires  on  the  crew.  Because  of  this  high  correlation,  esti¬ 
mates  of  individuals  of  the  strength  of  the  interest  of  their  crew  for  lead 
crew  duties  showed  the  same  relationship  to  ratings  of  the  creff  and  of  In¬ 
dividuals  as  was  described  above  for  strength  of  personal  interest 
A  low  but  significant  relationship  was  found  between  the  desires  of  the 
airplane  commander  and  those  of  other  crew  members  for  lead  crew  duty. 
There  was  no  evidence  that  personnel  of  one  aircrew  specialty  were  more 
desirous  than  those  of  any  other  for  lead  crew  assignment  All  personnel, 
regardless  of  position,  reported  on  the  average  they  were  highly  interested 
in  lead  crew  assignments. 

In  the  17  th  Wing  each  crew  member,  except  the  airplane  commander, 
indicated  on  a  9-point  scale  the  strength  of  his  interest  for  lead  crew  as¬ 
signment.  The  airplane  commander  was  asked  to  estimate  on  a  similar  form  - 
his  crew’s  desire  for  lead  duty.  The  correlation  coefficient  between  the  above 
estimates  and  instructors  ratings  of  proficiency  of  airplane  commanders  on 
Scale  B  was  0.29.  Correlation  coefficients  between  crew  members  prefer¬ 
ences  and  instructors  ratings  of  respective  crew  members  were:  0.25  for  148 
copilots;  0.17  for  155  navigators;  0.30  for  147  bombardiers;  0.18  for  143 
flight  engineers;  0.13  for  71  radar  observers.  While  low,  these  coefficients 
indicate  that  seme  relationship  existed  between  the  two  measures.  The 
correlation  coefficient  between  the  average  interest  of  all  crew  members 
except  the  airplane  commander  and  the  airplane  commanders’  estimates  of 
their  crews’  desires  for  lead  duty  was  0.29. 

On  the  basis  of  the  above  results,  conclusions  regarding  the  relationship 
between  interest  in  lead  crew  assignment  and  measures  of  proficiency  must 
be  highly  tentative.  It  does  appear,  however,  that  the  two  factors  are  re¬ 
lated  in  spite  of  the  inadequacy  of  the  criteria.  The  preliminary  research 
suggests  further  that  while  preferences  of  the  airplane  commander  were 
related  to  the  interests  oi  the  other  crew  members,  they  were  .not  major 
factors"  in  determining  those  interests.  The  level  of  interest  expressed  in 
lead  crew  assignment  was  high  throughout  with  no  specialty  showing  greater 
interest  than  any  other.  The  fact  that,  the  ratings  of  interest  were  bunched 
near  the  high  end  of  the  scale  probably  lowered  the  relationship  between  in¬ 
terest  and  proficiency. 

STUDIES  IN  THE  ASSEMBLY  OF  CREWS 

Problem 

Two  important  characteristics  of  good  lead  crews  have  implications  with 
respect  to  assignment  of  individuals  to  combat  crews,  ihese  are  proficiency 
(or  ability)  and  teamwork.  With  the  increasing  importance  of  lead  crews 
the  question  was:  given  a  particular  group  of  ind.  iduals  to  be  assigned  to 
combat  crews,  how  should  they  be  assigned  so  as  to  produce  the  maximum 
number  of  outstanding  crews?  A  number  of  factors  're  suggested  for  con- 

247 


.  r  ■+r&&axr. 


skkratiop  la  the  matching  of  individuals  for  assignment  to  particular  crews. 
AAF  Letter  50*117  specified  some  of  these  that  had  to  do  primarily  with 
proficiency.  Teamwork,  however,  depends  greatly  upon  how  well  crew 
members  get  along  with  each  other,  how  compatible  they  are.  Among  the 
factors  suggested  as  important  for  compatibility  were  age,  rank,  geographi¬ 
cal  origin,  hobbies  and  interests,  and  special  friendships.  It  was  the  opinio® 
of  training  personnel  that  individuals  that  were  similar  in  temu  of  these 
factors  would  be  more  compatible  than  individuals  that  had  extreme  dif- 
ferences  in  one  or  more  factors.  Some  study  was,  therefore,  made  of  the 
role  of  these  factors  in  the  assembly  of  crews. 

Evaluation  of  Crew  Assembly  In  the  Second  Air  Force 

Routine  procedure  for  the  assignment  of  individuals  to  crews  in  the  Third  j 
Air  Force  up  until  the  fall  of  1944  paid  little  attention  to  any  factors  that  ' 
might  improve  the  quality  of  the  crews  in  terms  of  proficiency  and  com¬ 
patibility.  Assignment  was  usually  based  solely  upon  military  occupational 
specialty  and  administrative  convenience.  In  the  Second  Air  Force,  how¬ 
ever,  processing  personnel  at  the  combat  crew  classification  and  routing 
pool  reported  that  an  attempt  was  made  to  secure  crews  with  good  morale 
by  sorting  the  trainees  into  crews  on  the  basis  of  compatibility.  For  ex¬ 
ample,  the  formal  structure  of  the  crew  requires  that  the  airplane  com¬ 
mander  be  in  charge.  An  attempt  was  made  to  assign  to  his  crew  other  crew 
members  who  would  accept  him  in  that  status  without  question.  Thus 
when  possible,  the  airplane  commander  was  the  oldest  and  highest  ranking 
officer  on  the  crew.  When  an  officer  or  EM  waiting  assignment  requested 
assignment  with  some  one  or  two  other  officers  or  EM.  this  was  done  if  it 
did  not  interfere  with  the  meeting  of  the  quotas.  Also  considered  to  a 
lesser  extent  were  geographical  background  and  experience.  No  conscious 
attempt  was  made  to  consider  proficiency  or  ability,  although,  it  was  well 
recognized  that  the  positions  of  a'rplane  commander  and  copilot  required 
different  levels  of  ability.  However,  the  decision  regarding  assignment  to 
one  of  the  two  positions  was  usually  made  in  the  AAF  Training  Command 
prior  to  arrival  in  the  Second  Air  Force. 

From  data  available  in  other  connections,  the  ages  and  stanines  of  air¬ 
crew  officers  were  obtained  for  approximately  24  CCTS  (H)  classes  in  the 
Second  Air  Force.  These  data  were  analyzed  to  determine  the  extent  to 
which  the  above  factors  were  considered  in  assigning  individuals  to  crews. 

In  table  11.23  are  given  the  means  and  standard  deviations  for  the  stanines 
and  J.ges  of  the  occupants  of  four  aircrew  positions  for  whicn  such  data 
were  available.  The  data  show  that  the  airplane  comm;  nders  tended  to  be 
slightly  older  than  the  other  officers.  The  differences  in  an  stanines  (ex¬ 
cept  for  airplane  commander  and  copilot)  reflected  larg  /  differences  in 
standards  of  admission  to  various  types  of  cadet  train-’ For  example, 
re  moments  for  navigation  training  had  long  been  high  *h»\r  !..v  the 
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other  specialties.  Since  the  assignment  of  pilots  as  airplane  commanders 
and  copilots  was  carried  out  in  the  AAF  Training  Command  supposedly 
without  knowledge  of  the  stanines,  the  difference  in  stanine  between  the 
two  would  seem  to  provide  additional  evidence  of  the  validity  of  the 
stanine. 


Tabu  It  Ji.—Agts  and  stanines  ef  air  erne  afUart 
24  *17  Arc  *-24  CCTS  CtASSES-S2X2ND  AT*  FOSCC 


In  table  11.24  are  given  the  correlations  between  the  stanines  and  ages  of 
the  airplane  commanders  and  those  of  the  other  crew  meubers.  It  can  be 
seat  that  age  was  given  considerable  weight  in  determining  assignments  to 
crews,  particularly  regards  airplane  commanders  and  copilots.  The 
positive  correlations  between  stanines,  though  low,  are  somewhat  un¬ 
expected  sinr*  aptitude  scores  presumably  were  not  considered  in  crew 
assignments.  The  most  obvious  explanation  would  seem  to  be  that  this 
relation  between  stanines  was  brought  about  indirectly  through  the  age 
factor.  If  the  older  and  more  experienced  copilots  were  assigned  to  the 
j»tne  crews  as  the  older  and  more  experienced  airplane  commanders,  two 
i*pes  of  influences  might  operate  to  produce  a  correlation  between  their 
stanines.  One  would  be  whatever  selective  factors  (either  positive  oc 
negative)  operated  to  delay  older  pilots  and  airplane  commanders  so  as  to 
arrive  at  the  same  time  at  the  stage  of  operational  training.  The  second 
type  of  influence  would  be  any  trends  in  population  stanines  over  a  period 
of  time,  with  different  pairs  of  airplane  commanders  and  copilots  bring 
drawn  from  different  testing  populations. 


Tabu  11.24. — Correlations  between  ages  and  stanines  of  airplane  commanders 
and  thou  of  other  crew  members 
24  B-17  AND  B-24  CCTS  CLASSES-SECONP  AIR  FORCE 
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.02 

.15 

465 

.14 

.33 

Crew  Changes  During  Operational  Training 

Analysis  was  made  of  the  crew  changes  occuring  in  two  B-24  CCTS 
classes  at  one  station  in  the  Fourth  Air  Force  and  in  rwe  B—17  and  B-24 
classes  at  five  stations  in  the  Second  Air  Force.  The  fi  ’uenaes  of  changes 
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The  *-»—«  for  the  crew  changes  la  the  5  CCTS  (H)  classes  it  ike 
Secoad  Air  Force  tie  pita  it  tabie  11-16.  Mere  than  fifty  percent  of  it 
changes  resulted  from  medical  disgi-aKficatiogs  or  LsccKzpetence  of  «e  m 
the  ■■■*■>■*"  of  the  anew.  Only  a  small  percentage  of  changes  was  n- 
ported  as  dae  to  incompatibility.  These  data  are  somewhat  misleading  sieae 
it  was  frequently  reported,  both  by  training  personnel  and  by  crew  sxm- 
bos  themsehes,  that  the  real  reasons  for  crew  changes  were  not  these 
«|w4fvft  in  the  nfiwial  records.  Because  of  the  numerous  diffienhws  »- 
vobed  in  obtaining  the  real  reasons  for  crew  changes  do  further  analyst 
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The  frequencies  with  which  70  crew  members  in  the  cl:  =ses  studied  & 
the  Fourth  Air  Force  cited  certain  factors  as  important  ii  musing  ere* 
:  .  j  >e  given  in  table  11.27.  Frt:".  tr.i?  table  it  is  app..  .  t  ••  t  1 


A  i 

1  I 


id]  Vyjtvwi  of  the  mao’s  home.  An  additional  criterion  lor  often  was  jA 
proficiency  and  for  enlisted  men,  sports  interest. 

Data  on  the  above  criteria,  with  the  exception  of  the  officer  job  profi¬ 
ciency,  were  obtained  either  from  the  WD  AGO  Form  66-2,  or  Fora  20, , 
or  during  the  interview  with  the  officer  or  EM  on  the  processing  line  at 
the  Third  Air  Force  Replacement  Depot,  Plant  Park-  Several  measures  of 
job  proficiency  were  obtained  for  the  officers  from  the  following  records: 
AAF  Training  Command  Proficiency  Card  (AFTRC  Form  2);  stanine 
scores  recorded  on  WD  AGO  Form  64;  and  bombing  accuracy  (bom¬ 
bardiers  only).  Because  of  the  nature  of  the  criteria  used  and  the  avail¬ 
ability  of  the  records,  EM  and  officers  were  first  matched  separately  into 
partial  crews  and  these  jiartial  crews  were  then  m-tebed  to  form  complete 
crews.  Insofar  as  poss’ole,  requests  to  be  placed  rn  the  same  crew  with 
another  individual  were  granted.  Using  the  criteria  '■‘nlKned  above,  504 
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ogreocest  was  obtained  than  would  be  expected  by  <-K*nr»  akne.  For  tie 
total  group  the  agreement  was  complete  for  73  J  percent  of  the  crews.  Tie 
difference  between  this  and  chance  expectancy  has  a  critical  ratio  of  2:2 
■which  is  significant  at  between  the  1  and  5  percent  levels. 

A  questionnaire  was  administered  to  combat  crew  members  to  obtain 
their  opiniot's  relative  to  the  use  of  such  factors  as  geographic  locati— > 
education  and  age  as  matching  principles  in  the  formation  of  crews.  I* 
table  11.29  are  presented  the  summaries  of  the  answc  3  to  the  question¬ 
naires.  Except  for  geographic  location,  a  substantial  majority  of  combat 
erp-w  trainees  supported  the  use  of  the  factors  used  in  the  Third  Air  Tore, 
for  the  formation  of  crews. 
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SUMMARY 

WHk  the  continual  devdopoest  and  revision  of  bombing  tfchmqnrs 
and  the  introduction  of  new  equipment,  the  lead  crew  assumed  ac  increas- 
a tfty  important  role  as  the  war  progressed.  Eight  mocths  after  research 
p^ddopsts  were  assigned  to  Continental  Air  Forces,  procedures  were 
established  for  the  assembly  of  all  crews  by  the  Training  Command  and  the 
designation  of  certain  of  these  crews  as  potential  lead  crews.  This  designa¬ 
tion  was  to  be  reviewed  and  changed  if  necessary  on  the  basis  of  perform¬ 
ance  in  operational  training.  Such  a  procedure  necessitated  thorough  study 
of  methods  for  evaluating  the  proficiency  of  crews.  Soon  after  they  were 
d-»rfw<  by  research  personnel  in  the  Second,  Third  and  Fourth  Air  Forces, 
these  studies  were  interrupted  by  tLe  cessation  of  hostilities  and  the  icsuft- 
ing  dosing  down  of  training.  Hence  the  data  presented  permit  only  tenta¬ 
tive  condasions. 

In  the  area  of  criteria,  measures  of  bomb'*-.*  accuracy,  especially  those 
of  rajar  bnnhing  of  industrial  targets  seated  particularly  good  as  criteria 
of  the  proficiency  of  the  crew  since  they  were  both  moderately  reliable  and 
represented  the  proficiency  of  all  members  of  the  bombing  team.  Three 
rating  scales  were  developed  and  analyzed;  two  in  the  Second  and  one  ® 
the  Fourth  Air  Force.  They  were  used  in  connection  with  B-29  training 
and  found  to  be  moderately  reliable.  One  result  that  seems  worthy  of  spe¬ 
cial  comment  in  connection  with  the  use  of  rating  scales  was  the  tendency 
for  over-all  judgments  to  be  more  reliable  than  ratings  on  specific  items  of  - 
behavior. 

Rate  of  mission  accomplishment  and  crew  awards  were  subject  to  many 
criticisms  and  were  not  considered  satisfactory  as  criterion  measures. 

The  stanines  of  individual  members  of  the  crew  showed  no  significant 
relationship  to  the  criteria  except  for  the  stanines  of  the  airplane  com¬ 
mander  which  showed  significant  correlation  with  training  accomplishment 
scores. 

Composite  stanines  such  as  the  average  stanir.  of  all  crew  members  or 
the  sum  of  their  stanines  showed  almost  no  reL  .  onship  to  the  various 
criteria  of  crew  proficiency. 

The  evidence  on  the  homogeneity  of  proficiency  '  crew  members  was 
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Crew  laaably  tirhaiqiiri  cstabfiahed  la  the  Third  Air  Force  with  tie 
aid  of  psychological  persoaad  prior  to  AAF  Letter  S(M17  oooid  aot  ado 
qaatdy  be  evaluated  with  the  avaSafaie  CacSdes. 

It  is  tlat  aaswers  to  soch  faadimental  questions  as  to  whether 

the  lead  crew  has  characteristics  above  and  apart  front  its  members  or  k 
Merely  the  soot  of  its  constituent  members  wfll  have  to  wait  upon  the  de» 
■rVy— —  of  more  adequate  criteria  both  of  crew  and  iadividtul  pn§- 
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CIAFIEK IYE1YK 


Studies  in  the  Acquisition  and 
Retention  of  Aircrew  Skills 


INTRODUCTION 

w#  the  aujor  responsibility  assigned  to  aviation  psychologists  m  the 
ftjotinaital  Air  Forces  was  that  of  obtaining  criterion  data  for  testvaBda- 
tian,  little  tim*  was  available  for  carrying  oat  studies  on  the  efficient 
jopgtioB  jad  retention  of  aircrew  skills.  The  few  studies  which  were  ac- 

were  necessarily  limited  in  scope  and  opportunistic  in  regard  to  . 
jabject  matter  and  design.  In  fact,  the  dement  of  experimental  design  in 
tw  of  differential  group  treatments  and  the  systematic  control  of 

aynrimt  conditions,  can  hardly  be  said  to  have  obtained  in  any  of  the 
to  be  described  in  this  chapter.  Nevertheless,  various  analyses  of 
the  available  training  records  have  been  made,  some  of  which  suggest  im¬ 
portant  modifications  of  future  operational  training  policies. 

At  the  outset,  the  reader  must  acquire  a  broad  understanding  of  die 
conditions  under  which  measures  of  skill  in  operational  training  were  ob¬ 
tained.  Although  many  of  the  conditions  have  been  discussed  elsewhere  in 
tins  volume,  especially  in  sections  dealing  with  the  reiiabOitY  of  measures 
of  proficiency,  further  discussion  is  appropriate  here.  It  should  be  ponded 
oat  that  fining  the  commitments  for  tiainul  men  to  combat  theaters  en¬ 
forced  the  strictest  kind  of  adherence  to  time  schedules  imposed  upon  train¬ 
ing  bases  by  higher  headquarters.  This  meant  that  conditions  could  seldom, 
if  ever,  be  kept  more  than  roughly  comparable  from  one  “trial”  or  practice 
period  to  the  next.  For  example,  it  is  known  that  numerous  factors  affect 
the  ability  of  the  fighter  pilot  student  to  secure  hits  on  an  aerial  target. 
The  airplane,  the  altitude,  the  direction  of  attack,  the  turbulence  .of  the 
air,  and  the  range  and  angle  off  at  which  firing  is  commenced  are  but  a  few 
of  these  factors.  Since  no  systematic  control  of  these  factors  was  possible, 
it  was  only  a  chance  matter  if  the  pattern  were  the  same  on  successive 
trials.  As  a  matter  of  fact,  from  the  standpoint  of  training  for  combat, 
constancy  of  conditions  would  have  been  highly  undesirable.  A  similar 
problem  existed  in  the  case  of  bombardment  skills.  In  synchronous  and 
foed-angle  bombing  the  skill  of  the  bombardier  w  s  affected  by  the  air¬ 
plane,  the  bombsight,  the  skill  of  the  pilot,  the  turL  lence  of  the  air,  the 
mechanical  condition  of  the  autopilot,  and  a  host  oi  other  factors  whkh 
varied  from  trial  to  trial  and  over  which  the  bombar  er  had  no  control. 
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as  these,  it  is  befieved  that  leanang  analyses  ate  justified,  if  for 
ream  thaa  the  fact  that  they  describe  operational  baking 
as  it  was  actually  found  ia  the  aaEtary  setting. 

Ia  this  ch^Xer,  rridence  viB  be  presented  concerning  (1)  repetition 
practice,  distribution  of  practice,  and  transfer  of  training  as  factors 
ing  the  acquisition  of  aircrew  drill*,  and  (2)  the  retention  of  fined 
•mt  A3k  over  periods  of  rime  ia  which  they 

operational 


FACTORS  AFFECTING  THE  ACQUISITION  OF  SKILLS 


i 

i 

! 


i 


i 


In  spite  of  the  bet  that  most  measures  of  aircrew  skills  have  only 
moderate  reliability,  there  is  some  evidence  to  indicate  that  such  Ails  ss 
fixed  aerial  gunnery,  flexible  aerial  gunnery,  and  radar  bombardment  im¬ 
prove  in  a  measurable  way  with  practice. 

Fixed  Aerial  Cmmaary 

/ 

Early  studies,  in  which  the  percents  of  hits  obtained  on  an  aerial  tasgd 
were  plotted  against  successive  scorable  missions,  were  somewhat  ambiguous 
with  respect  to  the  demonstration  of  learning.  From  the  data  predated  is 
table  12.1  it  would  appear  that  some  increment  in  score  was  present  is  bur 
out  of  the  five  classes  represented. 

More  conclusive  results  were  obtained  in  later  studies.  In  one  of  it 
was  possible  to  examine  the  scores  of  2  small  groups  of  instructors,  some  of 
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wyjm  had  preserved  their  records  for  as  aiany  as  tS  mbrioas.  When  fit 
pMOtnts  of  hits  for  successive  groops  of  fire  mbskrns  were  avenged  and 
jotted  against  a  time  axis,  the  carves  shown  in  figure  12.1  were  obtained. 
These  carves  demonstrate  small  but  definite  increments  per  unit  of  practice, 
«d,  for  all  practical  purposes,  seem  to  be  without  acceleration.  These  data 
gt  somewhat  ambiguous,  however,  since  the  popdatkn  decreased  from 
m  group  of  five  mhsioas  to  the  next  The  data  from  which  the  curves 
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were  plotted  are  shown  In  table  12J  in  comparison  with  the  results  of  ** 
deal  pilots  whose  records  extended  over  not  more  than  IS  mhsfcm. 

Inasmuch  as  there  were  rather  large  individual  differences  in  the  duet, 
accuracy  of  fighter  students  at  the  outset,  It  was  of  interest  to  obset* 
whether  continued  practice  in  gunnery  effected  a  reduction  of  these  & 
ferences.  For  this  pwpoae  one  saaD  groop  of  instructor  pffots  was  Added 
into  high-scoring  and  fcw-sccrii*  subgroups  upon  the  basis  of  the  accurst* 
demonstrated  on  the  first  10  missions.  The  nine  low-scoring  instruct** 
had  a  percent  hit  average  of  3  J  whfle  the  nine  high  scorers  had  an  awn* 
of  6JL  The  learning  curves  of  these  groups,  showing  the  avenge  percents 
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of  hits  for  successive  performance  units  of  5  missions  each,  are  shown  ■ 
figure  12.2.  From  this  figure  it  is  apparent  that  the  advantage  of  the 
initially  superior  group  is  maintained  for  approximately  45  missions.  After 
45  mi<sinn«  the  curves  are  extremely  irregular,  which  is  doubtless  a  function 
of  the  small  number  of  cases. 

The  foregoing  results  would  seem  to  indicate  that  learning  fixed  acrid 
gunnery  is  demonstra table  during  operational  training.  In  fact,  the  dita 
obtained  from  instructors  show  that  there.can  be  steady  improvement  over 
a  long  period  of  time  beyond  the  requirements  of  operational  training. 
There  is  no  evidence  that  the  tipper  limit  of  shooting  accuracy  had  bees 
reached  within  any  of  the  amounts  of  practice  studied. 

Flexible  Aerial  Gunnery 

For  the  demonstration  of  learning  in  flexible  aerial  gunnery,  small  group* 
of  data  were  available  from  a  gunnery  instructors  school  and  from  cocnbst 
crew  training  station  classes  in  the  Second  Air  Force.  These  data,  obtain^ 
from  two  successive  gun  camera  missions,  illustrate  the  progress  to  be  «* 
pected  with  the  use  of  both  noncomputing  and  B-29  computing  sight*- 
The  score  representing  prefidtney  with  the  computing  sight  is  a  compost 
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error  score  Involving  m3  error,  visual  target  size  In  percent,  and  an  over 
judgment  of  the  quality  of  the  film.  The  presence  of  learning  would 
shown  by  a  decrease  in  this  score  with  practice.  The  score  based  upon 
aoocomputing  sight  (waist  guns)  Is  equivalent  to  a  percent-of-hits  score, 
,rith  due  allowances  made  for  error  in  film  assessment  This  seme  would 
be  expected  to  increase  with  practice  if  learning  were  present 
The  changes  in  scores  from  the  first  to  the  second  missions  are  shown  In 
table  12J.  Changes  in  scores  from  the  first  to  the  second  attacks  In  the 
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first  mUAm  art  shown  la  table  12.4.  These  data  suggest  that  some  bo*, 
meat  la  proficiency  has  been  gained  although  because  of  the  small  numbers 
of  cases  the  differences  between  the  means  is  significant  only  la  the  case 
of  the  instructors  using  the  computing  sigh*. 
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Navigation 

Some  slight  evidence  of  learning  in  navigation  was  found  in  the  ratings 
given  to  430  navigators  on  three  successive  missions  in  the  Second  Air 
Force.  The  missions  were  graded  on  a  three-point  scale,  with  a  “3”  rep¬ 
resenting  the  best  performance.  The  average  ratings  were  1.91,  2.05  and 
2.13  with  standard  deviations  of  0.66,  0.68  and  0.62  for  the  first,  second 
and  third  missions  respectively.  The  difference  between  the  average  rating 
for  the  third  mission  and  that  for  the  first  mission  is  significant  at  the  one 
percent  level.  There  is  some  likelihood,  however,  that  this  increment  it 
rating  reflects  nothing  more  than  the  instructors’  beliefs  that  students 
should  improve  with  practice.  , 

i 

Distribution  of  Practice 

Training  policies  established  by  command  headquarters  usually  specified 
the  number  of  missions  to  be  flown  by  fighter  p3ot  students  for  the  accom¬ 
plishment  of  minimum  aerial  gunnery  requirements.  In  the  Fourth  Air 
Force  this  number  was  originally  set  at  six  missions.  In  actua?  practice, 
however,  the  number  of  missions  employed  was  found  to  vary  from  four  to 
eight  For  a  sample  of  221  studmts  trained  at  Van  N'uys  and  Ontario 
during  the  autumn  and  winter  months  of  1944,  the  distribution  of  missions 
flown  to  accomplish  2,000  rounds  of  aerial  gunnery  is  shown  in  table  12S 
From  this  table  it  is  evident  that  some  students  used  twice  the  number  of 
missions  to  meet  minimum  gunnery  requirements  as  did  others.  It  w*» 
thought  possible  that  the  factor  of  number  of  missions  would  bear  some 
consistent  relationship  to  final  proficiency. 
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la  order  to  investigate  the  possibility  that  the  number  of  t«i««t^  had 
socot  consistent  relationship  to  final  proficiency,  the  individual  aerial  gun¬ 
nery  mission  records  of  3  classes  (Fourth  Air  Force,  Ontario  A  and  B,  Van 
Xuys  IH)  were  examined.  For  each  student  the  mission  upon  which  ha 
fired  his  2,000th  round  was  noted,  together  with  his  percent  of  hits  for 
that  mission.  Discarded  tnm  the  analysis  were  cases  in  which  the  target 


Tm*  12 S.— Number  if  fixed  gunnery  missions  fiev»  to  oaomptbk 
minimum  requirement  of  2fi00  rounds 
»»  P-28  TRAINEES— FOCHTH  AIR  VORCS 
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had  been  lost  or  shot  off  on  the  final  mission.  The  remaining  cases  were 
then  sorted  into  mission-frequency  groups  within  classes.  The  average 
percent  of  hits  was  computed  for  each  mission-frequency  group.  Table 
12.6  presents  these  data  for  each  of  the  classes. 

From  table  12.6  it  is  evident  that  terminal  aerial  gunnery  proficiency  is 
a  positive  function  of  the  number  of  missions  over  which  the  required 
rounds  are  distributed.  It  is  believed  that  this  finding  is  in  accordance 
with  results  usually  obtained  in  distributed  practice  experiments,  although 


Tabu  12.6. — Average  percent  kits  on  find  aerial  ptnntry  mission  in  relation  to  number 
of  missions  flown  to  accomplish  minimum  of  2fl00  rounds 
221  P-38  TRAINEES — FOURTH  AIR  FORCE 
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it  should  be  noted  that  the  temporal  arrangement  of  “practice”  and  “rest” 
dements  is  somewhat  atypical.  In  the  typical  distributed  practice  experi¬ 
ment  either  the  length  of  time  between  practice  periods  or  the  amount  of 
practice  in  a  single  continuous  session  are  systematically  varied  while  other 
factors  are  controlled.  In  aerial  gunnery,  however,  the  design  is  not  so 
clear-cut.  Obvious  enough  is  the  fact  that  2,000  rounds  distributed  over  S 
Hussions  will  tend  to  be  fired  at  a  lower  rate  per  mission  than  they  would 
ke  if  distributed  over  only  4  missions.  If  it  is  assum  1  that  thr  number  of 
rounds  fired  per  pass  at  the  target  is  fairly  constant — and  instructors  report 
t^t  this  is  the  case,  though  they  may  be  wrong — it  i  '’lows  that  the  stu¬ 
dents  who  required  eight  missions  have  made  fewer  pas  per  -nission  than 
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The  factor  of  positive  transfer  bolds  tmsiderable  significante  for  * 
cxevr  training  for  open  the  extent  to  winch  it  can  be  realized  depends  fie 
successful  use  of  synthetic  training  devices.  It  is  obvious  that  if  transfer 
can  be  effected  from  performance  in  mock-ups  to  performance  in  the  air,  a 
considerable  saving  can  be  made  in  materials  to  say  nothing  of  time  neces¬ 
sarily  expended  in  training. 

Upon  the  m  priori  assumption  that  transfer  of  training  could  be  obtained, 
the  Array  Air  Forces  has  made  extensive  use  of  synethetic  training  devices 
One  of  these  was  the  Gunairstructor.  The  Gunairstructor  is  a  trainaf 
device  for  fixed  gunnery,  intended  to  simulate  aerial  combat  and  to  provide 
practice  in  control  coordination,  aircraft  alignment,  range  estimation,  and 
deflection  allowance.  The  equipment  was  mounted  in  a  specially  con¬ 
structed  dark  room.  The  student,  sitting  in  a  standard  fighter  aircraft 
cockpit  equipped  w  th  regulation  controls,  fired  at  the  image  of  a  movia? 
target  (an  an  plane  silhouette)  controlled  by  the  operator.  The  imag* 
was  projected  upon  a  screen  in  front  of  the  student’s  cockpit.  In  order  to 
register  hits  the  student  had  '3  establish  the  correct  deflection  allowance 
and  alignment  When  hits  were  scored  the  target  blinked  red  and  an  auto¬ 
matic  device  recorded  the  number  of  rounds  fired  and  the  number  of  hit* 
scored.  Since  the  path  and  attitude  of  the  target  airplane  w-re  control!^ 
by  the  operator,  it  was  possible  for  him  to  present  problems  v^uch  varied 
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M  Jifc  dty.  ladiridaal  trainbg  sessions  were  usually  IS  waetia  a  k^tL 
Jb  view  o I  the  tnyhias  placed  oa  the  Gucairslnictar  as  a 
Jnrjc-,  it  became  iagortant  to  debnnsoe  whether  its  use  resdted 
■  aerial  gnarexy  profideocy.  Ahboegh  the  erigrnon  of  I 
the  execntkw  of  is  experiment  designed  to  cvaholc  the 
the  device  under  optical  ccodhkns  of  use,  it  was  nerathdes  pcaafcfo 
nibble  ata  for  the  psrpase  of  detenu seng,  i 
of  use,  (3)  whether  amocat  of  practice  oa  2e  device 
jfr^tod  with  aerial  gtaoeiy  profideocjr  (2)  whether  gwenexy 
GwaaastnKtar  proficiency  readied  from  a  co— bow  set  of 

,  and,  if  wot,  (3)  what  cooStioes  of  actual  oprratioB  peodaced  tike 
icwMinalitf  cf  the  two  perfoan«aces. 

Ammo*  of  training. — h  order  to  ascertaiD  the  effect  of  varying  awwwtt 
cf  Pahang  epow  aerial  gunnery  proficiency,  the  data  bom  two  fighter  pdot  - 
doses  (Fourth  Air  Force,  Van  Nays  I  and  H)  were  tmaed.  For  each 
Am  the  nomber  of  training  sessxezs  ergaged  ia  by  the  stadeats  varied 
horn  4  to  25.  The  nomber  of  sessions  was  administratively  determined  aad 
■as  not  a  fonction  of  the  ability  of  the  student  as  far  as  coaid  be  deter- 
oimrA  The  product-motne*  u  correlation  between  size  of  aerial  gUDoexy 
save  and  number  of  synthetic  training  sessions  was,  therefore,  directly 
■topcetable.  These  conriations,  with  distribetkm  statistics,  are  shown  ia 
hfe  12.7.  It  is  evident  from  these  results  that  the  aerial  gunnery  per- v 
Wmanre  of  fighter  students  with  many  synthetic  training  sessions 
significantly  different  from  that  of  students  with  few  such  sessions. 


Tabu  12J  — ComUHons  hetnxea  tie  camber  of 
trmaaxc  sokoms  cad  femat  Mts  m  raid 
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Commonality  of  aerial  and  synthetic  performances. — If  the  Gunairstnic- 
tor  has  rationale  as  a  synthetic  training  device  for  fixed  gunnery,  it  would 
seem  that  the  two  performances  should  be  so  similar  as  to  be  significantly 
correlated.  The  student  who  scores  many  hits  in  the  Gucairs true  tor  does 
so  presumably  because  he  has  learned  to  solve  the  problems  of  range,  de¬ 
flection,  alignment  and  control  coordination.  Solving  these  problems  on  the 
ground  should  bear  some  relation  to  solving  them  in  the  air.  In  order  to 
determine  the  extent  of  this  relationship  the  product-moment  correlation 
between  percent  hits  in  the  training  device  and  per  nt  hits  in  the  air  was 
computed  for  one  class  (Fourth  Air  Force,  Van  h.  "s  II).  The  results, 
shown  in  table  12.8  indicate  that  the  two  scores  exhioit  no  communality. 

Factors  reducing  the  efficacy  of  the  Gunairstructor.  -In  an  effort  to  ex¬ 
plain  the  foregoing  results,  additional  studies  of  syn  tic  Gaining  were 
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observed  that  they 

pccbfem  <S tterty  *** 
they  were  required  to 
a  via 

sad/or  objectivity 


directed  to  the  operetta,  Met  It 
considerable  freedom  fc  sack  a*. 

of  instmdionai  «pacn  * 
periodic  ntiop  cf  their  tfvWh* 
efidewdes.  Alack* 
of  these  operator  frtcrioas  mi'J k 


hnely  account  far  the  resets  of  the  foregoing  inquiries  mfc»  the  eScacy 
of  the  Baa**  device  Aoccrdh^f ,  a*  analysis  «s  fast  made  of  tie 
xm+rrprn t  lauqg  operators  in  the  manner  of  instruction.  The  data  (pet- 
^  Kts)  far  a  «g|e  practice  session  ior  312  students  in  3  classes  (Fort 
Air  Force,  Van  Nays  1,3,  and  HI)  *.cre  sorted  by  dass  and  then  by  op¬ 
erator  ridm  each  The  variances  attributable  to  classes,  operators, 
discrepance  and  error  were  determined.  As  shown  in  table  125 
the  of  the  fast  three  variances  was  established  by  the  F-test 
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These  results  indicate  (1)  that  there  were  significant  differences  in  scorn 
between  groups,  (2)  that  instructors  differed  from  one  another  in  the 
scores  which  they  gave  and  (3)  that  a  given  instructor’s  scoring  tendency 
varied  from  class  to  class. 

The  adequacy  of  synthetic  instruction  was  examined  further  by  as 
analysis  of  the  skill  with  which  operators  could  diagnose  and  correct  in* 
dividual  deficiencies  in  lead  estimation,  angle  estimation,  and  control  co¬ 
ordination,  It  was  assumed  that,  under  adequate  conditions  of  instruction 
and  rating  of  performance,  the  scores  made  on  the  Gunairstructor  would  ex¬ 
hibit  some  communaiity  with  ratings  by  instructors.  The  analysis  consisted 
of  the  computation  of  biserial  coefficients  of  correlation  between  ratings  and 
scores  for  each  of  three  items  rated.  The  discrete  variable  consisted  o1  * 
below-average/above-average  dichotomy.  The  three  biserM  coefficients 
thus  obtained-  ranged  -from  0.06  to  0.19.  If  it  is  granted  that  the  scorinf 
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j&sb  the  cefy  valid  measure  of  the  quality  of  performance,  the*  it  fe 
aidal  that  operators  mere  unable  to  distinguish  between  food  and  bad 
performance.  It  follows  that  they  could  not  reasonably  have  bee* 

B  diagnose  a ad  coned  individual  deficiencies,  with  the  result  that  a 
gal  transfer  of  training  could  not  have  been  brought  about  thereby. 

What  has  been  demonstrated  in  the  above  analysis  is  ihat’the  profit  to  be 
pjaed  from  training  on  the  Gunairstrodor  wider  haphazard  f 

af  iastractioc  is  negligible.  Crucial  studies  involving  the  carefd  control  of 
frr»»"g  conditions  most  be  made  before  a  final  evaluation  of  the  Goutr* 
jtrador,  or  any  other  synthetic  device,  can  be 

the  retention  of  skills  during  periods  of  disuse 

la  the  handling  of  assignments  and  shipments  of  large  aariien  of  men, 
jt  is  inevitable  that  some  individuals  wiH  be  subject'*!  to  periods  of  in- 
activity  as  regards  the  practice  of  their  special  skills.  It  is  of  greet  prac¬ 
tical  importance,  therefore,  to  determine  whether  these  periods  of  disuse 
•f  ^3h  result  in  a  reduction  of  proficiency. 

Two  studies  were  undertaken  in  the  Fourth  Air  Force  to  deienuine  the 
extent  to  which  varying  periods  of  lack  of  practice  affected  proficiency.  Li 
eae  study  of  300  fighter  pilots  who  completed  P-38  training;  it  was  found 
that  the  average  air-to-ground  gunnery  score  of  those  who  were  inactive  for 
aslong  as  200  days  was  only  6  percent  poorer  than  that  of  pilots  who  were 
mac the  for  not  over  50  days.  In  the  other  study,  involving  bombardiers,  it 
ns  found  that  the  average  circular  bombing  error  for  those  who  were  in¬ 
active  for  as  long  as  90  days  was  only  one  percent  poorer  than  that  of 
bombardiers  who  were  inactive  for  no  more  than  30  days.  For  the  periods 
of  time  studied,  therefore,  the  loss  of  proficiency  resulting  from  periods  of 
inactivity  appears  to  be  negligible.  - 

SUMMARY 

Several  studies  of  the  acquisition  and  retention  of  aircrew  skins  have 
been  reviewed.  In  these  reviews  the  reader’s  attention  has  been  called  to 
the  difficulty  of  performing  adequate  and  crucial  investigations  under  the 
exigencies  of  wartime  training.  In  spite  of  these  difficulties,  however,  cer¬ 
tain  problems  have  been  studied  with  some  profit.  Learning  in  several 
skills  was  demonstrated.  Lack  of  systematic  control  of  training  conditions 
was  shown  to  prevent  the-  clear  demonstration  of  transfer  of  skills  from 
synthetic  settings  to  aerial  situations.  Finally,  son?.^  light  was  thrown  upon 
the  question  of  what  happens  to  aircrew  skills  during  periods  of  inactivity. 
There  are,  of  course,  many  other  1 1  oblems  in  th*.  avtu  which  warrant  in¬ 
stigation.  If  useful  results  are  to  be  obtained,  hr  «o«r,  these  studies  must 
be  performed  with  some  regard  for  the  principles  e.  experimental  design. 


tOJJJO— 47 — II 


4** 


mrm  naira _ 

Attitudes  of  Aircrew  Personnel 
Returned  From  Combat  Toward 
Further  Duly 


ATRODUCriON 

At  tie  direction  of  the  Research  Division,  Office  of  the  Air  Suigeea, 
Headquarters  Army  Air  Forces,  the  Research  Section  of  the  Thin!  As 
Force  conducted  a  survey  of  the  attitudes  of  aircrew  o5ctr$  and  gunners 
returned  to  the  United  States  after  a  tour  of  combat  duty.  The  survey  ms 
concerned  -oiefly  with  the  attitudes  of  these  returnees  toward  their  further 
utilization  in  the  Air  Forces,  including  their  attitude  toward  a  second  tow 
of  combat  duty.  An  analysis  was  made  of  the  effect  of  factors  such  as  age, 
grade,  and  severity  of  combat  experience  on  the  attitude  of  these  returnees. 
Inform  tier,  obtained  from  questionnaires  was  supplemented  by  interviews 
with  l  tumees,  commanding  officers,  training  officers  and  flight  «anyww 
Since  the  survev  of  the  attitudes  of  returned  aircrew  officers  and  the  study 
of  returned  gunners  were  carried  out  independently,  the  two  studies  ait 
discussed  separately  on  the  following  pages. 

SURVEY  OF  RETURNED  AIRCREW  OFFICERS 

.  Method 

Research  personnel  visited  26  out  of  38  main  stations  in  the  Third  Air 
Force  administering  a  questionnaire  to  a  representative  group  of  S28  re* 
turned  aircrew  officers  in  ali.  This  sample  was  carefully  selected  to  re¬ 
semble  as  closely  as  possible  the  total  group  of  returned  aircrew  officers 
in  the  Third  Air  Force  with  respect  to  grade,  rating,  (pilot,  bombardier, 
navigator),  combat  theater  and  length  of  time  in  the  United  States  since 
return  from  combat.  When  time  permitted,  information  obtained  from  the 
questionnaire  was  supplemented  by  interviews  with  the  returnees. 

The  questionnaire  {see  appendix  II)  submitted  to  the  officers  consisted 
of  77  items  covering  the  following  areas: 

Willingness  to  return  for  second  tv>ur  of  combat  duty.  Length  of  stay  in 
the  United  States. 

Combat  experiences. 

Attitude  toword  further  training. 

Pr  .'sent  job  assignment  and  job  satisfaction. 
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The  responses  of  the  returnees  were  recorded  oo  IBM  punch  cards. 
Sample  sortings  were  made  oo  all  items.  Inieritem  counts  were  made  to 
determine  the  effect  of  varbas  factors  upon  the  returnees’  attitudes  as 
effected  in  certain  critical  items.  The  difference  between  groups  wickh  are 
ggatiooed  in  the  following  discussion  are  statistically  significant  at  least 
at  the  5  percent  level.  In  some  comparisons,  responses  to  similar  items 
vere  pooled  in  order  to  increase  the  number  of  cases  upon  which  to  cam* 
pate  the  significance  of  the  difference.  The  sample  questionnaire  in  ap¬ 
pendix  LI  indodes  a  tabulation  of  the  percentage  of  responses  to  each 
alternative  of  all  hems. 


General  Characteristics  oj  Returned  Ofcers  - 

An  accurate  interpretation  of  the  findings  of  this  survey  requires  a 
Inoiriedge  of  the  composition  of  the  sample.  The  following  paragraphs 
summarize  pertinent  characteristics  of  the  returnees. 

1.  Personal  characteristics,  a.  Grade.— Slightly  more  than  half  of  the 
returnees  were  first  lieutenants;  one  third  of  them  were  captains. 

h.  Age. _ About  half  of  the  returnees  were  between  the  ages  of  24  and  26. 

c.  Marital  status. — Slightly  more  than  one-third  were  single.  Of  the  61 
percent  who  were  married.  43  percent  had  married  since  their  return  from 
mmlar. 

d.  Dependents. — Slightly  more  than  one-third  had  no  dependents;  61 
percent  had  I  or  2  dependents,  including  wife. 

•  Education. — Twenty-eight  percent  had  no  college  training;  52  per¬ 
cent  had  from  1  to  3  years  college,  and  the  remaining  20  percent  had  4 
years  or  more  of  college. 

i.  Time  in  the  United  States  since  return  prom  combat.— Mon  than  two- 

thirds  of  the  returnees  had  been  back  from  3  to  12  months.  _ 

2.  Facts  about  combat  tour. — a.  Approximately  60  percent  were  pilots 
or  copilots,  19  percent  were  navigators  and  21  percent  were  bombardiers. 

b.  About  20  percent  flew  in  group  lead  positions  as  pilots,  bombardiers 

or  navigators  while  in  combat 

c.  Theaters  were  represented  in  the  samples  as  follows:  European  17 . 
percent,  Mediterranean  44  percent,  Pacific  27  percent,  others  12  percent- 

d.  Fifty-seven  percent  of  the  group  had  been  overseas  from  9  to  14 

months  inclusive.  ,  . 

e.  The  median  number  of  missions  was  in  the  interval  between  41  to  50. 

Seventeen  percent  reported  70  or  more  missions. 

f.  Slightly  less  than  half  of  the  group  flew  between  100  and  200  combat 

hours;  30  percent  flew  between  200  and  300  hears.  '. 

g.  Ten  percent  completed  less  than  the  require,  number  of  missions  for 
their  theaters.  Forty-one  percent  reported  no  poll-/  in  effect  relative  to 
the  required  number  of  missions. 

h.  More  than  half  of  the  sample  were  assigned  *  medium  and  light 


i 
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bombers,  22  percent  flew  heavy  bombers;  19  percent  flew  fighter  aircraft. 

L  Rotation  policy  was  responsible  for  the  return  of  SS  percent,  2S  per. 
mt  were  returned  because  of  combat  fatigue,  wounds  or  injuries. 

j.  Only  S  percent  of  the  sample  were  on  limited  service  status  at  fe 
time  of  study. 

3.  Severity  of  combat  experience,— a.  Almost  half  of  the  returnees  had 
f  ppf  yjfnrfd  forced  landings  in  friendly  territory.  Seven  percent  were  forced 
down  in  enemy  territory. 

b.  More  than  two- thirds  met  enemy  opposition  cn  every  or  nearly  evey 

c.  Six  percent  had  bailed  out  in  either  friendly  or  enemy  territory. 

d.  Nineteen  percent  were  wounded  is  combat;  12  percent  sustained  in¬ 
juries  in  mnn-rtinn  with  aircraft  in  non-combat  situations. 

e.  Twenty-nine  percent  reported  having  suffered  from  operational  fa’igoe. 

f.  Thirteen  percent  reported  having  members  of  their  crew  killed,  42  per¬ 
cent  reported  wounds  among  their  crew  members. 

j.  Almost  ball  (40  percent)  reported  a  fourth  or  more  of  their  daw 
friends  missing,  killed  or  wounded. 

h.  Eight  percent  reported  experiencing  air-sickness  sometime  during  their 
combat  tour. 

4.  Current  duty  assignment. — Sixty-five  percent  of  the  officers  were  as¬ 
signed  as  flying  instructors;  17  percent  had  flying  duties  other  than  in¬ 
structing.  Fire  percent  were  ground  school  instructors  and  13  percent  were 
assigned  to  administrative  duties. 

Willingness  to  Return  to  Combat 

Three  questions  were  so  w^  ded  as  to  determine  in  a  specific  way  the 
willingness  of ’these  aircrew  officers  to  return  to  combat  The  first  question 
was  concerned  with  the  attitude  of  the  officer  toward  return  within  various 
periods  of  time;  the  second  was  concerned  with  the  willingness  to  volunteer 
for  a  second  tour;  the  third  was  concerned  with  the  strength  of  desire  to 
return  to  combat  Thirteen  percent  indicated  they  would  return  at  once. 
An  additional  15  percent  would  return  within  6  months.  More  than  half 
of  the  officers  would  not  volunteer  for  a  second  tour  and  only  30  percent 
expressed  any  desire  at  all  to  return  to  combat.  The  three  questions  were 
found  to  be  highly  reliable  in  that  if  an  individual  answered  one  question 
by  indicating  great  willingness  to  return,  he  answered  the  other  question 
with  responses  indicative  of  great  willingness.  The  sa~  was  true  of  those 
indicating  a  reluctance  to  return;  their  responses  on  the  other  questions 
indicated  a  similar  reluctance. 

Factors  A  Ejecting  Willingness  to  Return  to  Combat 

The  willingness  of  officers  to  return  was  found  to  be  related  in  various 
ways  to  other  variables  on  which  data  were  collected.  These  factors  at* 
listed  below. 
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1.  Rank.  There  was  no  dear  cvt  evidence  that  rank  was  related  to 
viQingness  to  return  for  another  tour,  although  It  was  found  that 

were  more  willing  to  return  than  were  first  lieutenants. 

2.  Marital  status —Married  officers,  regardless  of  whether  they  were 
married  before  or  since  their  tour  of  duty,  were  less  desirous  of  returning  to 
combat  than  were  angle  officers.  This  was  verified  by  the  fact  that  family 
ties  and  obligations  were  given  most  often  as  the  reason  for  not 

to  return  to  combat. 

3.  Length  of  time  in  United  States. — The  longer  officers  had  been  in  *M« 
country  the  more  wiling  they  were  to  return  to  combat  duty. 

4-  Duty  assignment. — In  general,  officers  assigned  to  flying  duty  were 
more  willing  to  return  than  officers  in  other  assignments.  A  greater  per¬ 
centage  of  officers  who  were  assigned  as  operations  officers  were  willing  to 

I  return  than  of  officers  in  any  other  military  occupational  specialty. 

5.  Military  status.— A  larger  percentage  of  officers  who  were  in  the  Reg¬ 
ular  Army  or  National  Guard  were  willing  to  return  than  officers  who  had 
no  such  connection. 

6.  Amount  of  combat  experience. — In  general,  the  greater  the  number  of 
missions  completed  the  less  willing  the  officer  to  return  to 

7.  Type  of  aircraft  used  in  combat. — A  greater  percentage  of  those  of- 
|  feers  who  had  combat  experience  in  B-26  type  aircraft  expressed  willing- 
!  aess  to  return  than  was  the  case  with  any  other  aircraft.  Fighter  pilots 
;  showed  the  next  highest  percentage  willing  to  return, 
jj  8.  Severity  of  combat  experience. — The  more  severe  the  enemy  oppari- 
j  tion  encountered  the  greater  the  proportion  of  .individuals  who  expressed  a 
j  strong  desire  not  to  return  -.o  combat.  A  greater  percentage  of  officers  who 

^  had  histories  of  combat  fatigue  were  unwilling  to  return  than  of  officers 

.  without  such  histories. 

fl 

.  9.  Degree  of  satisfaction  with  general  conditions  in  the  United  States. — 

.  More  of  the  officers  who  expressed  dissatisfaction  with  military  courtesy, 

discipline  and  training  in  the  Zone  of  Interior  were  willing  to  return  than 
was  the  case  for  officers  expressing  dissatisfaction  with  other  conditions. 

10.  Attitude  toward  assignment. — Those  officers  who  were  indifferent  to 
their  assignment  were  more  willing  to  return  than  were  officers  who  were 
either  satisfied  or  dissatisfied  with  thei  present  jobs.  A  greater  proportion 
of  officers  who  felt  that  lit  Me  n  - .  was  being  made  of  their  ability  or  ex- 
j!  perience  were  willing  to  return  than  cf  officers  who  felt  good  use  was 

being  made  of  their  abilities.  More  of  the  officers  who  desired  flying 

duties  not  involving  instruction  were  willing  to  return  than  officers  desiring 
other  types  of  assignment.  Officers  who  desired  ground  duty  were  least 
willing  to  return  to  combat 

11.  Attitude  toward  combat  effectiveness. — Moi  of  the  officers  who  felt 
a  that  their  stay  in  the  United  States  since  returning  from  combat  had  in¬ 
creased  their  combat  efficiency  were  willing  to  return  to  combat  than  of¬ 
ficers  who  felt  their  efficiency  had  been  unaffected  or  Vcreared. 
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1*.  Desk*  for  retention  in  the  erwy.— Officers  who  desired  to  temafe  <* 
active  doty  with  the  Air  Forces  (Regular  Array)  were  more  willing  to  to 
turn  than  were  officers  who  desired  to  return  to  civilian  life. 

13,  Future  combat  conditions.— Sixty-two  percent  of  the  returnees  fe- 
dicated  they  would  be  more  willing  to  return  with  a  crew  all  of  who* 
members  had  combat  experience.  Slightly  more  than  half  would  be  mote 
willing  to  return  if  given  an  assignment  not  involving  frequent  combat  ty¬ 
ing.  Assignment  to  very  heavy  bombardment  aircraft  would  also  increase 
willingness  to  return  to  combat 

Factors  Not  Related  to  Willingness  to  Return  to  Combat 

No  relationship  was  found  between  willingness  to  return  for  a  second 
tour  of  combat  duty  and  any  of  the  following  variables:  Age,  aeronautical 
rating,  length  of  time  overseas,  number  of  combat  flying  hours,  theater  of 
previous  combat  experience  and  number  of  friends  who  were  casualties. 

Motivation  During  Combat 

Although  somewhat  outside  the  scope  of  the  survey,  an  attempt  was 
made  to  determine  the  relitive  strength  of  various  motivating  factors  dur¬ 
ing  combat.  The  two  factors  checked  by  almost  three- fourths  of  the  re¬ 
turnees  as  having  greatly  influenced  them  while  in  combat  were:  Desire 
to  do  a  good  job  and  preference  for  flying  duty  rather  than  ground  duty. 
Less  than  half  of  the  returnees  were  greatly  influenced  by  such  factors  as: 
The  exci'mnent  of  combat,  not  wanting  to  let  other  crew  members  down,, 
being  ordered  to  perform  the  duties  by  authorities  or  regarding  their  assign¬ 
ments  as  the  best  way  to  strike  the  enemy.  Only  a  small  percentage  re¬ 
ported  that  they  were  strongly  motivated  to  return  to  combat  by  such 
factors  as  desire  to  square  accounts  with  the  enemy  because  of  the  loss  of 
friends,  preference  for  combat  duty  over  present  assignment,  dissatisfaction 
with  conditions  in  the  United  States  or  a  desire  to  be  in  the  middle  of 
things  rather  than  on  the  sidelines. 

Utilisation  of  Returned  Officers  in  the  Zone  of  the  Interior 

1.  Present  assignment. — The  duties  to  which  the  officers  were  assiped 
together  with  the  percentages  in  each  are  shown  in  table  13.1. 

2.  Satisfaction  with  job  assignment . — More  than  70  percent  were  satis¬ 
fied  with  their  job  assignment  and  felt  that  good  use  was  being  made  ol 
their  ability  and  experience.  Officers  who  held  lead  positions  in  combat 


Table  13.1. — Duty  assignments  and  preferences  of  aircrew  officers 


Dot y 

I 

I  Percent 
[  sstlgned 

Percent 

desiring 

Flying  duty  u  Instructor . , . „ . 

6S 

M 

Flying  duty  not  ts  instructor . . . . 

S7 

Ground  sc&ooi  Instructor . . 

s 

1 

AdmiaUtrtUve  ground  duties . . . . . . . . i 

13 

it 

_ _ 

1  Individual  were  permitted  to  express  preference  for  more  th*p  one  nssiguMec. 
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were  l»s  often  satisfied  with  their  duties  than  officers  without  that  ex* 
perknce.  Ground  school  instructors  were  less  satisfied  than  officers  In  other 
assignments.  Officers  who  had  been  in  the  United  States  longest  were  W 
satisfied  than  officers  more  recently  returned. 

3.  Preferred  assignment. — The  returned  officers  expressed  preferences 

for  assignment  as  shown  in  table  13.1.  Also  shown  are  the  duty  assign* 
merits  of  these  officers.  There  are  marked  discrepancies  between  the  actual 
assignments  made  and  the  preferences  regaiding  assignments.  However, 
the  fact  .-'at  more  than  70  percent  expressed  themselves  as  with 

their  assignments  suggests  that  a  general  good  adjustment  was  being  made 
by  the  returned  officers. 

Certain  variables  were  found  related  to  duty  preferences.  There  was  a 
general  tendency  for  the  proportion  desiring  administrative  duties  to  in* 
crease  with  increasing  rank.  The  proportion  of  officers  who  desired  ad* 
minis trative  duties  increased  with  the  amount  of  education  they  had  re¬ 
ceived.  A  greater  proportion  of  pilots  desired  nonicstructional  flying  duties 
than  did  navigators  and  bombardiers.  Officers  who  had  considerable  re¬ 
sponsibility  in  combat  were  less  desirous  of  flying  instructor  assignments 
than  officers  with  less  responsibility.  More  fighter  pilots  preferred  flying 
instruction  duties  than  bombardment  pilots.  Over  60  percent  of  the  of¬ 
ficers  who  were  dissatisfied  with  their  assignment  preferred  flying  duties 
other  than  as  an  instructor.  More  of  the  officers  who  desired  to  remain  in 
the  Air  Forces  preferred  flying  duties  than  officers  who  had  no  desire  to 
remain. 

4.  Present  combat  efficiency. — Slightly  more  than  half  of  the  officers 
felt  that  their  stay  in  the  United  States  had  increased  their  efficiency  for 
future  combat  duty. 

5.  Attitude  toward  further  training. — Almost  all  (95  percent)  of  tLc  ' 
turnees  desired  further  technical  training  in  the  Army.  Pilots  expressed 
a  desire  for  engineering  training.  Most  of  the  navigators  and  bombardiers 
desired  pilot  training.  Although  given  the  opportunity  to  select  training 
other  than  in  Army  specialties,  the  subjects  most  frequently  selected  fell  in 
this  categoty. 

6.  Post-war  army  plans. — More  than  half  of  the  officers  expressed  a  de¬ 
sire  to  remain  on  active  duty  with  the  Air  Forces  (Regular  Army).  Slightly 
more  than  one-third  preferred  Reserve  Officer  Status.  Only  4  percent  de¬ 
sired  to  return  to  civilian  life  without  retaining  any  army  affiliation.  More 
of  the  officers  with  the  rank  of  major  and  captain  preferred  Regular  Army 
status  than  officers  of  lower  rank.  Married  officers  were  more  interested 
than  single  officers  in  such  an  assignment.  More  pilots  were  interested  in  a 
career  in  the  Regular  Army  than  other  aircrew  specialists. 

Comments  of  Commanding  Officers,  Training  Offi.  rs  and  Flight  Surgeons 

Station  commanders,  flight  surgeons,  directors  of  training,  directors  of 
administration,  air  inspectors  and  administrative  i  rectors  were  in  sub- 
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SURVEY  OF  RETURNED  GUNNERS 


interviewed  564  returned  gunners  and  arimhastered 

*  41111  riiiniiTT  to  2,659  mote  To  supplement  the  information  obtained 
ftea  interview  and  qoestioaoiire,  124  officers  (cornmaiiduig  officers,  fight 
japa,  and  training  officers)  were  interviewed.  The  questionnaire  (see 

L2)  consisted  of  S5  items  and  covered  the  same  areas  as  did  Oe 
rifir»r  questionnaire  described  above.  The  method  of  analyzing  the  nsdb 
was  the  «”»  as  that  discussed  earlier  for  the  returned  officers.  Ahbocqfr 
the  gunners  were  asked  to  sign  their  questionnaire,  it  was  explained  tint 
me  desired  only  to  facilitate  obtaining  further  information  fna 
their  Soldier’s  Qualification  Cards.  It  was  felt  that  frank  answers  were 
and  the  results  could  be  considered  accurate  reflections  of 
the  attitudes  of  the  individuals  sampled.  The  results  of  the  interviews  sub¬ 
stantiate  in  all  respects  those  obtained  from  the  questionnaire  and  there¬ 
fore  are  not  presented  separately  in  the  following  discussion.  The  sample 
questionnaire  in  the  appendix  gives  the  percentage  of  the  gunners  respond¬ 
ing  to  each  alternative  of  aS  the  questions. 

Benoits 

General  Characteristics  oj  Returned  Gunners 

I.  Personal  characteristics,  a.  Grade. — More  than  90  percent  of  the 
gunners  were  high  ranking  noncommissioned  officers  (staff  and  technical 
sergeants). 

b.  Age. — More  than  60  percent  were  between  the  ages  of  21  and  20 
years  of  age. 

c.  Marital  status. — Slightly  more  than  half  of  the  gunners  were  single, 

with  no  dependents.  t 

d.  Education. — About  60  percent  had  had  3  to  4  years  of  high  school 
or  vocational  schoc1.  A  vpry  small  percentage  had  tr.  ning  beyond  high 
school 

e.  Time  in  the  United  States  since  return  from  combat.— About  two- 

•  hi.  is  of  the  gunners  had  been  in  the  United  States  from  1  to  7  months 
since  return  from  combat. 

+ 
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2.  facts  abomt  combat  tear.—*.  Approximately  'oc-toorik  wen  •»-  - 
tfcaacal  specialists  sod»  as  engineers,  crew  duels  or  mechanics  in  addition 
la  being  gunners  while  in  combat;  slightly  more  than  one-tHrc*  were 
fgmottr  gunners;  ooe-fifth  were  radio  or  radar  gunners  and  slightly  more 
tkaa  one-tenth  were  gunners  csSy. 

b.  More  than  hail  5csr  *3  or  most  of  their  missions  in  B-17  type  air* 
oaft  B-24  gunners  were  next  In  frequency  (22  percent)  followed  by  B-25 
jams  A  negligible  number  were  assigned  to  other  aircraft 

c.  Thirty-six  percent  were  based  in  England;  35  percent  were  from  the 
Ifafitenancan  Theater.  The  remainder  were  principally  from  the  Pacific 
Thealrr. 

d.  The  gunners  were  distributed  fairty  equally  among  the  various  gun 

except  for  the  nose  position  which  had  markedly  fewer  representa* 
ti«s.  The  relatively  small  number  of  nose  gunners  is  probably  explained 
by  the  fact  that  bombardiers  frequently  fired  the  nose  guns. 

e.  Most  of  the  gunners  had  been  overseas  from  7  to  14  months  and  had 
flown  from  20  to  50  missions. 

f  About  half  of  the  gunners  flew  exactly  the  number  of  missions  re¬ 
quired  by  the  theater.  A  fifth  reported  no  policy  in  effect  regarding  num¬ 
ber  of  missions. 

3.  Severity  of  combat  experience—*.  Slightly  less  than  half  of  the  gun¬ 
ners  had  experienced  crash  landings.  ! 

1  b.  More  than  80  percent  reported  enemy  opposition  on  all  or  almost 


! 
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all  missions. 

c  About  10  percent  had  bailed  out  of  disabled  aircraft. 

d.  Twenty  percent  were  wounded  in  combat 

e.  Almost  half  of  the  gunners  were  given  some  sort  of  treatment  foe  op¬ 
erational  fatigue.  _  #  ' 

f.  About  one-fourth  of  the  gunners  reported  fatalities  among  their  crew 

members;  more  than  half  reported  wounds  among  fellow  crewmen. 

g.  The  majority  of  the  gunners  were  returned  as  a  result  of  the  rotation 

policy  prevailing  at  the  time  of  their  tour. 


riUingness  to  Return  to  Combat 

Only  6  percent  of  the  guuners  were  willing  to  return  to  combat  im- 
ediately.  Sixteen  percent  had  “some”  desire  to  return  or  were  mdrfferent 
•ward  return.  The  majority  were  not  desirous  of  a  second  tour.  More 
tan  half  preferred  being  assigned  to  duty  as  basic  soldiers  to  bei  g 
imed  to  combat.-  Approximately  half  indicated  they  would  be  wilhng 
>  return  only  after  all  available  trained  gunners  bad  been  sent  to  combat. 


Factors  Affecting  Willingness  to  Return  to  Combat 

1.  Marital  status— Single  men  were  more  willinj 

return  for  a  second  tour. 

2.  Amount  o)  combat  experience.— Gunners  who 


than  married  men  to 
•  spent  more  than  18 

273 


months  overseas  during  their  first  tour  were  more  willing  to  return  than 
gunners  who  had  spent  less  time. 

3.  Tinier, . — Gunners  from  other  theaters  than  the  European,  lfag, 
tenanean  and  Pacific  were  more  willing  to  return  than  gunners  from 
theaters.  Gunners  from  the  China-Burma-India,  Carribbean,  Alaskan  and 
other  theaters  were  inclined  to  explain  any  lack  of  willingness  to  return 
to  combat  on  the  grounds  that  they  had  made  their  combat  contribute 
Gunners  who  bad  experience  against  the  Germans,  on  the  other  hand,  were 
reluctant  to  return  because  they  felt  that  they  could  -°.ot  stand  the  strain  of 
further  combat.  - 

4.  Type  oj  aircraft. — In  general,  type  of  aircraft  had  no  affect  upon 
willingness  to  return. 

5.  Cress  position. — Radio  gunners  were  less  willing  to  return  than  gun¬ 
ners  in  other  positions. 

6.  Severity  of  combat  experience. — Specific  factors  indicative  of  the 
severity  of  combat  experience,  such  as  number  of  bail-outs,  crash  landing 
injuries  or  fatalities  among  fellow  crewmen  were  not  found  related  to  wil¬ 
lingness  to  return.  However,  the  general  factor  related  to  severity  of  com¬ 
bat  experience,  namely,  history  of  operational  fatigue,  did  show  such  a 
relationship.  Gunners  with  histones  of  operational  fatigue  were  lea  wi¬ 
ling  to  return  than  were  gunners  without  that  history. 

Utilisation  of  Returned  Gunners  in  the  Zone  of  Interior 

1.  Job  assignments. — The  gunners  in  the  sample  were  assigned  as  fol¬ 
lows:  57  percent  instructors  on  flying  status;  21  percent  ground  instructors 
in  gunnery,  armament,  radio,  mechanics,  etc.;  10  percent  ground  duty  not 
involving  instruction;  3  percent  instructing  other  than  above;  1  percent 
clerical  and  administrative  work;  8  percent  no  assignment 

2.  Job  satisfaction. — Sixty-eight  percent  of  the  gunners  were  satisfied 
with  their  job  assignments.  Seventy-two  percent  felt  that  the  army  was 
making  good  use  of  their  ability  and  experience.  The  longer  a  gunner  had 
been  in  the  United  States  the  more  likely  it  was  that  he  was  satisfied  with 
his  assignment 

Attitude  Toward  Further  Training 

About  40  percent  felt  they  needed  no  further  gunnery  training.  Twenty* 
seven  percent  felt  the  need  for  more  training  in  air-to-air  firing.  Certain 
important  courses  had  been  omitted  in  the  original  training  of  these  gun¬ 
ners,  as  evidenced  by  the  fact  that  53  percent  had  had  no  gun  camera  mis* 
sions  and  29  percent  had  no  course  in  position  firing.  With  regard  to 
additional  training  in  specialties  other  than  gunnery,  37  percent  indicated 
they  needed  no  further  training.  Additional  training  in  such  areas  as 
armament, '  mechanics  and  radio  operations  was  considered  necessary  by 
from  10-15  percent  of  the  gunners.  Fifty  percent  of  the  gut  ters  reported 
that  they  were  interested  in  attending  school  while  in  the  Arm, ,  in  prepara* 
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tioo  for  return  to  civilian  life,  provided  the  courses  were  not  restricted  to 
jnny  specialists.  Courses  most  often  requested  were  in  mechanics,  bust* 
ness,  radio  and  radar,  special  trades  and  high  school  subjects. 

Comments  by  Commanding  Officers,  Training  Officers  and  Flight  Surgeons 

The  officers  interviewed  were  in  substantial  agreement  that  the  majority 
of  the  gunners  were  making  an  adequate  adjustment  upon  return  to  the 
United  States.  This  adjustment,  in  their  opinion,  took  from  3  to  6  months. 
Hie  officers  stated  that  surplus  gunners  could  be  absorbed  by  return  to 
combat,  reclassification  to  other  jobs  and  by  replacement  of  gunnery  In¬ 
structors  without  combat  experience.  Only  about  10  percent  were  in  deft- . 
nite  need  of  immediate  discharge,  according  to  officers  interviewed.  The 
officers  felt  that  the  returned  gunners  were  in  need  of  further  “on-the-job’* 
training. 


CHAPTIE  IOMBK _ _ 

Summary  and  Evaluation 


INTRODUCTION 

In  this  final  chapter,  an  attempt  will  be  made  to  summarize  the  more 
important  conclusions  which  came  out  of  the  work  herein  reported,  and  to 
evaluate  the  results  obtained  In  this  connection  the  point  of  view  from 
winch  judgments  are  made  is  an  important  consideration.  In  the  case  of 
the  present  report,  at  least  three  viewpoints  can  be  taken,  each  with  some 
reason.  The  material  can  be  reviewed  in  terms  of  the  formal  missions  of 
the  psychological  sections,  as  described  in  chapter  1,  with  conclusions 
stated  in  terms  of  how  completely  the  stated  objectives  were  attuned. 
Again,  the  report  may  be  examined  to  discover  what  contributions  have 
been  made  to  Army  Air  Forces  selection  and  training  procedures.  This 
type  of  evaluation  can  be  made  only  in  terms  of  possible  post-war  con* 
tributions,  since  this  research  resulted  in  only  minor  changes  in  operating 
Drocedures  in  the  Continental  Air  Forces  during  the  war.  From  a  third 
frame  of  reference,  the  results  may  be  reviewed  as  a  contribution  by 
psychologists- to  the  methods  and  subject  matter  of  aviation  psychology. 
As  was  the  case  with  other  sections  of  the  Aviation  Psychology  Program, 
the  research  workers  in  the  Continental  Air  Forces  enjoyed  an  unusual  op¬ 
portunity  for  application  of  psychological  principles  to  problems  of  sdec- 
tion  and  training  involving  very  large  populations,  larger  than  are  available 
in  most  peacetime  military,  educational,  or  industrial  situations.  This  lat¬ 
ter  point  of  view  would  place  chief  emphasis  on  the  methods  used  to  secure 
the  data,  on  the  problems  (and  in  some  cases  the  anomalies)  arising  in  the 
statistical  handling  of  the  data,  and  on  the  development  of  criteria  for 
judging  the  practical  usefulness  of  relationships  discovered. 

Throughout  this  chapter,  the  attempt  will  be  made  to  discuss  the  research 
in  terms  of  all  three  of  these  methods  ot  evaluation.  However,  the  writers 
have  perhaps  been  most  concerned  with  evaluation  of  the  work  in  terms  of  a 
scientific  project,  as  is  indicated  in  the  last  of  the  three  approaches.  This 
position  has  been  taken  advisedly,  in  line  with  the  general  conviction  th*>* 
the  largest  national  service  can  be  rendered  in  a  continuous  effort  to  revise 
experimental  hypotheses,  sharpen  research  tools  and  perfect  the  methods 
used  in  investigating  fundamental  or  underlying  facts  whether  the  phenom¬ 
ena  be  physical,  psychological  or  social. 

The  evaluations  offered  will  be  confined  to  a  discussion  of  the  problems 
and  findings  presented  in  the  chapters  on  the  seven  aircrew  positions,  on 
the  ciew  as  a  whole,  and  on  studies  in  the  acquisition  of  skills.  No  further 
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murks  wili  be  made  on  the  study  of  attitudes  of  aircrew  personnel  re¬ 
turned  from  combat,  done  by  the  Third  Air  Force,  nor  on  the  mlsceS*  - 
ianeous  studies  reported  in  chapter  12.  While  these  were  undertaken  under 
either  broad  or  specific  provisions  of  directives  from  Headquarters,  Army 
Air  Forces,  they  were  somewhat  aside  from  the  main  stream  of  the  research 
effort  of  the  Aviation  Psychology  Program,  and,  therefore,  will  be  allowed 
to  stand  alone. 

Discussion  in  this  chapter  will  proceed  under  four  major  topics:  organisa¬ 
tion  and  operating  procedures,  analyses  of  duties,  criteria  of  proficiency  and 
validation  of  stanines  and  test  scores.  While  the  obvious  orientation  of  this 
section  and  of  the  work  it  reviews  is  toward  evaluation  and  improvement 
of  psychological  selection  procedures,  the  close  connection  between  selection 
and  training  procedures  can  hardly  be  overemphasized.  For  example*  while 
the  criteria  of  proficiency  were  studied  primarily  to  find  scores  against 
which  to  validate  tests,  they  would  often  have  been  equally  useful  in 
evaluating  training.  For  only  insofar  as  measures  of  achievement  existed, 
with  which  individuals  were  measured  from  time  to  time  throughout  d 
course  of  training,  could  the  effectiveness  of  the  efforts  spent  in  training  be 
critically  appraised.  ~ 


ORGANIZATION  AND  GENERAL  OPERATING  PROCEDURES 

Certain  comments  need  to  be  made  on  administrative  experience  gained 
in  fulfilling  the  assigned  missions  in  the  four  continental  air  forces.  Tins 
experience  revealed  several  factors  which  affected  in  an  important  way  the 
accomplishment  of  research  in  the  operational  training  situation. 


Numbe  r  of  Research  Personnel  _ 

In  the  first  place,  it  seems  almost  self-evident  that  the  number  of  psy¬ 
chologists  assigned  was  insufficient  for  adequate  completion  of  the  pro- 
scribed  mission.  From  the  fall  of  1944  until  the  dose  of  the  war,  there 
were  at  most  times  roughly  4,000  combat  crews  in  trammg  at  the  appraxi- 
raately  80  CCTS  and  OTU  stations  in  the  4  numbered  air  forces.  There 
were  in  addition  more  than  20  stations  devoted  to  the  training  of  figh 
pilots.  It  was  impossible  with  the  available  personnel  to  make  more  than 
an  occasional  visit  to  most  of  these  stations,  so  that  deluded  procedural * 
the  assignment  of  grades  and  evaluation  of  performance  coidd  not  often 
be  followed  up  on  the  spot.  There  was  thus  no  way  rcs^ch  person^ 
could  keep  track  of  the  frequent  changes  m  training  ] ° J* 
special  conditions  which  frequently  arose  m  the  training  d  a  particular 

^HeTe'rogeneity  of  training  and  the  vas’  size  of  the  air  forces  prevented 
avSychologist,  in  three  of  them  fre  ,  maintaining  comple e  cove^ 
of  ail  trainees  being  trained  in  their  comi.  unds.  rhe,e  two  iactom  were 

somewhat  less  in  evidence  in  the  First  Air  Fwce  ^e,n^Ybhto^ 
...  ,  „  Arn  researc  personnel  were  able  to  con- 

ment  training  was  done  and  where  resean..  . 
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mtrite  upon  s  type  of  mining — P— 47  fighter  pQot  tninlog  k 
was  thus  possible  la  the  First  Air  Force  to  keep  a  complete  file  of  the  P-47 
trainees  In  the  command.  The  problem  could  not  be  solved  in  the  other 
three  air  forces  by  having  a  small  staff  at  headquarters  perform  the  evalua¬ 
tion  studies,  since  proficiency  records  of  individual  trainees  were  not  often 
transmitted  from  station  to  headquarters,  and  since  the  local  stations  bad 
a  great  deal  of  autouomy  in  carrying  out  their  training.  Only  at  the  station 
level  were  the  actual  names  of  crew  members  available  prior  to  completion 
of  operational  training  and  assignment  to  staging  for  combat 
The  small  number  of  aviation  psychologists  available  had  another  ef¬ 
fect  on  research  in  the  Continental  Air  Forces.  Because  there  were  so  few 
of  them,  research  personnel  hesitatrd  to  undertake  the  tremendous  job  of 
instituting  new  procedures  of  evaluation  ct  any  large  number  of  stations  in 
the  various  air  forces,  and  spent  considerable  time  studying  and  attempting 
to  use  wrwting  records  and  routine  procedures,  even  when  it  was  apparent 
that  such  records  and  procedures  were  far  from  ideal. 


Allocation  of  Research  Personnel 


Since  in  the  Second  Air  Force,  the  aviation  psychologists  were  assigned 
to  each  training  wing,  while  in  the  other  air  forces  they  were  concentrated 
at  a  central  point,  some  question  arises  as  to  which  was  the  more  effective 
organizational  plan.  In  general,  it  is  believed  that  concentration  was  more 
effective.  However,  there  were  some  advantages  to  deployment  in  the 
*  wings.  These  included  location  in  the  geographical  vicinity  of  a  number  of 
bases  which  carried  on  the  same  type  of  training,  and  direct  contact  with  a 
headquarters  primarily  concerned  with  fulfilling  training  directives.  On 
the  other  hand,  day  to  day  contact  with  each  other  in  central  units  enabled 
research  personnel  to  criticize  and  revise  research  procedures  and  to  pool 
statistical  services.  Visits  to  bases  were  made  on  a  temporary  duty  basis, 
and,  While  likely  to  be  less  frequent  than  those  made  from  the  wing,  were 
probably  equally  effective.  Continuous  discussion  at  the  central  point  made 
it  possible  to  shift  research  emphases  and  to  transfer  work  to  those  bases 
where  conditions  were  most  suitable  to  the  research  being  undertaken. 


Ejecting  Useful  Research  in  Operational  Training  Situations 

Throughout  the  psychological  program,  an  attempt  was  continuous!;.* 
made  to  judge  the  importance  of  any  research  undertaking  in  terms  of  i«$ 
possible  contribution  to  the  war  effort.  In  order  for  the  results  of  research 
to  lead  to  action,  an  operating  problem  had  to  exist  and  be  recognized  by 
command  and  administrative  personnel.  The  research  then  had  to  be  di¬ 
rected  fairly  specifically  toward  a  solution  of  that  problem.  In  the  case  of 
studies  on  the  validation  of  test  scores  and  stanines  the  action  was  dear 
enough.  Any  new  facts  regarding  the  relative  validities  of  tests  could  be 
readily  used  in  revision  of  the  classification  test  battery  administered  in  the 
psychological  units  of  the  training  command. 
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Io  other  types  of  studies  the  mechanisms  for  getting  action  based  on  re* 
search  results  had  to  be  worked  out.  For  example,  for  a  long  time  it  was 
believed  by  various  officers  in  the  air  forces  that  crews  should  be  assembled 
before  training  on  some  sort  of  proficiency  basis,  and  that  information  on 
the  relative  success  of  the  whole  crew  in  training  should  be  transmitted  to 
the  overseas  commander  for  use  in  determining  suitable  crew  assignments. 
Some  research  had  been  done  by  psychologists  on  the  characteristics  of 
successful  lead  crews.  However,  research  in  methods  of  crew  evaluation  was 
not  always  supported  locally  and  did  not  at  first  have  any  practical  out- 
mme.  Later,  psychologists  had  opportunity  to  make  recc:nmendations  in 
a  planning  conference  and  aided  in  the  preparation  at  Headquarters,  Army 
Air  Forces,  of  an  AAF  Letter  outlining  specific  procedures  to  be  used  in  as¬ 
signing  crews  and  directing  that  their  proficiency  be  routinely  evaluated  aft 
the  station  level. ,  Since  this  AAF  Letter  required  that  an  evaluation  be  sent 
overseas  with  each  crew,  it  was  possible  to  send  through  command  chan¬ 
nels  a  letter  from  Headquarters,  Continental  Air  Forces,  directing  each 
member  air  force  to  undertake  research  on  individual  and  crew  proficiency 
measurement  in  order  to  establish  suitable  procedures  for  use  in  the  evalua¬ 
tion  called  for  in  the  AAF  Letter.  With  this  clear  administrative  need  for 
a  measuring  instrument  at  the  station  level,  psychologists  were  invited  to 
work  in  close  cooperation  with  training  personnel  on  the  solution  -of  what 
was  now  a  practical  problem  of  immediate  interest  to.  all  concerned.  This 
experience  illustrat  e  how  proper  coordination  of  research  objectives  at  all 
levels  of  commands  often  results  in  better  recognition  of  the  need  for  cer¬ 
tain  research  and  brings  about  closer  cooperation  among  interested  sections 
in  the  attainment  of  the  research  objectives. 

ANALYSIS  OF  DUTIES 

Job  analysis  is  a  technique  or  a  tool  which  is  almost  always  employed  by 
the  psychologist  when  faced  with  problems  of  selection  or  classification  for 
jobs  in  industry.  The  type  of  analysis,  and  the  level  of  detail  in  description 
of  the  duties  depend  upon  what  use  is  to  be  made  of  the  information. 
Throughout  the  Aviation  Psychology  Program  frequent  use  has  been  made 
of  job  analysis  techniques.  In  the  early  days  of  the  program,  a  series  of 
bulletins  on  the  analysis  of  duties  of  all  aircrew  positions  was  published  for 
the  guidance  of  research  workers  in  devising  tests  and  test  procedures. 
Informal  analyses  were  constantly  being  made  as  research  workers  came  in 
contact  with  aircrew  personnel  on  the  job.  The  Psychological  Research 
Projects  for  each  aircrew  position,  located  in  the  AAF  Training  Command, 
devoted  considerable  effort  to  systematic  and  relatively  exhaustive  job 
analyses  of  the  aircrew  position  with  which  they  were  concerned,  especially 
to  the  students’  job  in  the  early  stages  of  training.  Research  workers  m  the 
Continental  Air  Forces,  on  the  other  hand,  did  ..oft  undertake  extensive  for¬ 
mal  job  analyses  of  aircrew  duties  since  job  requirements  in  operational 
training  were  essentially  similar  to  those  in  the  v\F  Training  Command, 
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although  perhaps  different  in  some  Jetafls.  However,  reference  was  mad, 
throughout  the  text  of  this  report  to  training  manuals,  etc,  whicn  outlined 
wW  and  how  various  skills  were  to  be  exercised  and  what  further  train, 
ing  was  given  in  each  specialty  in  operational  training.  • 

In  this  connection,  it  might  be  argued  that,  in  one  sense,  the  studies  of 
the  criteria  reported  in  the  preceding  chapters  represent  job  analyses  of  a 
sort  The  object  of  these  efforts  was  to  discover  or  to  develop  methods  of 
measuring  individual  differences  in  skill  or  competence  on  the  job,  and 
decided  for  success  upon  how  representative  each  variable  was  of  the  in- 
dividual’s  skill  in  the  total  requirements  of  the  job.  Insofar  as  variables 
were  discovered  and  measured  in  which  individuals  on  the  job  did  differ 
from  one  another  in  manner  of  performance,  it  may  be  said  that  an  opera¬ 
tional  definition  of  the  job  was  developed.  Obviously,  such  criteria  in  the 
aggregate  do  not  enumerate  all  the  activities  required  nor  off  skills  and 
aptitudes  which  must  be  present  in  at  least  minimal  amounts  for  the  in¬ 
dividual  to  hold  the  job  at  sfl. 

Some  attempts  at  systematic  job  analyses  were  made  for  three  types  of 
aircrew  duties  in  the.  training  air  forces.  These  analyses  emphasized  espe¬ 
cially  the  phases  of  the  job  which  were  new  to  the  trainee  when  he  entered 
operational  training  from  the  AAF  Training  Command. 

Fighter  Pilot 

The  first  of  the  more  detailed  analyses  had  to  do  with  the  job  of  the 
fighter  pilot,  that  is,  the  job  of  the  man  who  had  just  learned  to  fly  an  air¬ 
plane  and  now  had  the  job  of  learning  to  fight  with  it.  The  skills  required 
were  determined  by  interview,  by  examination  of  training  directives,  by 
study  of  ratings  and  objective  criteria,  and  from  analysis  of  records  of  ac¬ 
cidents  and  Fiying  Evaluation  Board  proceedings.  Traits,  defined  as  those 
modes  of  behavior  which  appear  to  spring  from  the  psychological  back¬ 
ground  of  the  pilot,  were  determined  chiefly  by  interviews  with  trainees, 
instructors  and  returned  combat  pilots.  The  general  conclusion  of  these 
investigations  was  that  within  the  Continental  Air  Forces  almost  all  the 
students  possessed  the  minimum  flying  skills,  (perhaps  because  the  weaker 
students  were  eliminated  in  the  Training  Command),  so  that  many  of  the 
most  important  differences  between  good  and  poor  pilots  lay  in  the  per¬ 
sonality  characteristics  determining  aggressiveness,  ability  to  take  respon¬ 
sibility  and  judgment 

Airplane  Comm  ander 

The  second  area  of  job  analysis  was  that  of  the  airplane  commander. 
Here  attention  was  centered  not  only  on  the  skills  and  traits  required  in 
flying  a  bombardment  aircraft,  but  also  in  the  requirements  for  the  ade¬ 
quate  exercise  of  command  and  leadership  in  a  military  situation.  Two 
approaches  were  made:  one  through  direct  observation  of  the  airplane 
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commander  in  the  air  on  training  missions,  and  the  other  through  the  cot* 
lection  of  reports  from  returned  combat  personnel  and  trainees  about  situa- 
lions  in  which  airplane  commander  ability  was  exercised.  The  results  of 
these  studies  point  to  the  importance  of  certain  personality  characteristics 
which  seem  to  determine  success  in  leadership  and  command,  characteristic? 
which  were  assessed  to  only  a  very  limited  extent  in  preselection  and  clas¬ 
sification  procedures.  The  research  workers  also  observed  that  relatively 
little  training  was  given  the  airplane  commander  in  the  techniques  of  leader¬ 
ship  or  the  ways  of  exercising  command.  It  is  the  opinion  of  the  writers 
that  specific  instruction  can  be  given  in  these  matters,  and  that  it  is  essen¬ 
tial  to  set  up  special  instructional  procedures  in  command  techniques, 
utilizing  the  known  principles  of  executive  leadership  combined  with  illus¬ 
trations  of  the  adequate  exercise  of  command  in  aerial  bombardment  war¬ 
fare.  To  young  pilots,  it  is  believed  that  much  distilled  experience  in  com¬ 
bat  training  leadership  could  be  transmitted  by  precept  and  example 
through  instruction  specific  to  the  duties  and  responsibilities  of  the  airplane 
commander.  ' 

'« 

The  Bombardment  Crew 

The  third  area  for  specific  job-analysis  was  that  of  the  crew-as-a-whole, 
with  particular  attention  to  the  duties  and  responsibilities  of  the  lead  crew. 
Source  material  for  these  studies  was  confined  to  interviews  with  Instructors 
and  especially  aircrew  members  returned  from  combat  Unanimous  agree¬ 
ment  was  quickly  reached  on  the  importance  of  individual  proficiency  in 
determining  the  success  of  the  crew.  Also,  the  necessity  for  teamwork  and 
cooperation  among  all  members  was  heavily  stressed.  However  entire 
agreement  was  not  reached  in  the  interesting  question  of  whether  a  com¬ 
plete  assessment  of  the  individual  proficiencies  of  each  crew  member  would 
give  an  adequate  measure  of  the  proficiency  of  the  crew  as  a  whole.  The 
question  is  an  important  one,  and  some  opportunity  for  a  quantitative 
answer  to  it  was  set  up  in  the  procedures  established  under  AAF  Letter 
50-117.  However,  hostilities  ceased  and  combat  crew  training  was  stopped 

before  an  answer  could  be  obtained. 

--  \ 

CRITERIA 

Studies  of  the  criteri-  of  proficiency  of  individuals  and  crews  in  opera¬ 
tional  training  constituted  the  most  important  activity  of  aviation  psy¬ 
chologists  in  the  Continental  Air  Forces.  Reliable  measurement  of  skill  In 
job  performance  is,  of  course,  fundamental  to  any  adequate  assessment  of 
either  selection  or  training  procedures.  In  this  seel  m  the  criteria  of  profi¬ 
ciency  studied  are  discussed  briefly  in  terms  of  certam  important  character¬ 
istics  and  there  is  also  brief  discussion  of  some  of  to-'  special  conditions  of 
operational  training  which  influenced  the  outcome  of  studies  made. 
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Classification  of  Proficiency  Criteria 
General  Comments 

Criteria  of  proficiency  might  be  classified  in  an  almost  infinite  number 
of  different  ways.  The  particular  categories  chosen  for  the  analyses  in  this 
section  are  thus  but  a  few  out  of  many  possible  classifications.  As  wifi  be 
obvious  upon  examination,  the  various  categories  of  classification  are  not 
in  practice  by  any  means  independent  of  one  another.  However,  each 
dimension  of  classification  given  does  represent  a  somewhat  different  em¬ 
phasis,  and  an  emphasis  which  is  believed  by  the  authors  to  be  of  interest 
in  the  consideration  of  the  criteria. 

Directness  . 

The  first  dimension  in  terms  of  which  the  criteria  are  classified  below  is 
the  directness-indirectness  of  the  measurement  cf  the  skill  involved.  This 
dimension  runs  from  those  criteria  which  measure  the  actual  performance  of 
some  aspect  of  the  job  of  the  aircrew  member  concerned,  as  for  example, 
the  number  of  hits  that  a  fighter  pilot  gets  in  an  aerial  target,  to  some 
measure  of  an  indirect  outcome  of  skillful  performance  of  the  job  such  as 
rate  of  training  accomplishment.  Analysis  in  terms  of  this  dimension  is 
important  in  the  selection  of  criteria  for  use  in  training,  where  the  meet 
direct  a  criterion  is,  the  more  effective  it  is  likely  to  be  in  the  learning 

situation.  .  , 

/ 

Generality  ,  •  .. 

A  second  continuum  on  which  proficiency  criteria  may  be  placed  might 
be  called  generality-specificity.  It  refers  to  the  extent  to  which  a  measure 
gets  at  the  total  performance  of  an  aircrew  member  on  his  job.  For  ex¬ 
ample,  the  records  of  landing  and  take-offs  obtained  from  mobile  control 
.  -.its  represent  specific  or  limited  aspects  of  the  job  of  fighter  pilot,  while 
rauking  airplane  commanders  in  order  of  expected  proficiency  in  combat 
represents  a  very  general  measure. 

While  of  tv/c  criteria  otherwise  equally  desirable  the  more  general  would 
probably  be  best,  for  use  as  a  sole  criterion,  it  would  be  quite  possible  for 
a  combination  of  specific  criteria  to  be  superior  to  any  available  combi¬ 
nation  of  general  criteria.  In  this  connection  the  question  arises  of  how 
various  specific  measures  are  related  to  each  other  and  how  an  estimate  of  an 
individual’s  over-all  proficiency  on  the  job  can  be  most  economically  derived. 
A  number  of  separate  specific  criteria  are  likely  to  be  more  useful  in  train¬ 
ing  than  general  criteria  since  they  would  reveal  specific  weaknesses  in  the 
results  of  training  and  would  direct  the  attention  of  instructors  and  students 
thereto. 

Simplicity 

Precise  measurement  constitutes  the  cornerstone  of  any  scientific  edifice- 
In  the  last  analysis,  all  measurement  depends  on  a  judgment  made  by  an 
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observer.  The  object  in  developing  precise  instruments  and  techniques  of 
measurement  is  to  provide  situations  such  that  the  judgments  made  by  d>* 
servers  are  as  simple  as  possible.  Reading  the  scale  value  to  which  an  ‘ 
instrument  needle  is  pointing,  is  one  of  the  simpler  types  of  judgment 
Rating  a  personality  characteristic  of  a  pilot  trainee  is  (me  of  the  more 
complex  types.  Thus  one  of  the  most  important  categories  of 
of  criteria  in  this  report  is  that  described  fa  terms  of  the  simplicity-com¬ 
plexity  aspect  of  the  judgmental  situation. 

Objectivity 

There  might  be  some  question  as  to  whether  there  be  needed  to  consider 
the  objectivity-subjectivity  of  criteria  in  addition  to  their  classification  in 
terms  of  simplicity.  Certainly  judgments  made  in  simple  situations  are 
less  likely  to  be  influenced  by  subjective  factors  than  those  involving  ex¬ 
treme  complexity.  However,  it  is  believea  that  the  emphasis  Is  sufficiently 
different  to  warrant  consideration  of  the  various  criteria  in  terms  of  objec¬ 
tivity  as  well  as  simplicity. 

Permanence 

The  final  dimension  or  category  of  classification  of  criteria,  is  that  defined 
in  terms  of  the  permanence- transitoriness  of  the  nature  of  the  phenomena 
observed.  Results  of  written  proficiency  examinations,  the  answer  sheets 
of  which  might  be  held  indefinitely,  would  represent  relativdy  permanent 
criteria.  The  judgment  by  the  mobile  control  unit  operator  regarding  the  . 
quality  of  a  particular  landing  of  a  plane  would  represent  a  criterion  at  the 
transitory  end  of  the  scale. 

In  table  14.1  the  criteria  used  in  the  studies  reported  in  this  volume  are 
roughly  categorized  in  terms  of  the  dimensions  described  above,  tinder 
each  dimension,  each  criterion  is  given  a  value  of  “H,”  “M,”  or  “L,”  rep¬ 
resenting  high,  moderate  or  little  amount  of  the  criterion-  quality  rep¬ 
resented  by  the  first  term  of  each  pair  describing  the  various  dimensions. 
Thus  in  the  column  marked  “Sim.-Comp.”  an  “H”  would  mean  a  criterion 
such  that  the  observation  involved  only  a  simple  judgment  while  an  “L” 
would  refer  to  a  criterion  such  that  a  complex  judgment  was  involved.  An 
“M”  would  refer  to  a  criterion  lying  between  the  two  extremes.  It  is  recog¬ 
nized  that  the  particular  values  listed  for  the  various  criteria  in  table  14.1 
are  somewhat  arbitrary.  However,  they  represent  the  composite  judgment 
of  several  aviation  psychologists  who  participated  in  the  collection  and 
analysis  of  much  of  the  criterion  data. 

Also  shown  in  the  table  are  rough  averages  of  the  reliability  coefficients 
for  various  proficiency  criteria.  The  approximate  numbers  of  cases  in¬ 
cluded  are  shown  in  parentheses  following  each  cc  ^icient.  Mission  grades 
and  comment  scores  are  seen  to  have  the  highest  degree  of  reliability  of  all 
the  criteria  studied.  Gunnery  scores,  bombing  see  es  and  sortie  grades 
have  moderate  reliability.  With  the  exception  of  tlu  utings  of  individual 
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._«.  I*  ;.  ’  various  criteria  of  navigation  proficiency,  gtta 
_ra  stores  and  variun  ground  trainer  scores  have  a  low  degree  of  «. 

*  "iiv. 

v  i  :i  0?  Meric.*  PiCcL  ;na  EncounUKd 
Ya.JUit? 

^.evghcul  the  Continental  Air  Forces,  there  were  great  variations  fa 
ir-i-nng  procedures,  in  methods  of  recording  proficiency  and  in  the  inter* 
pr.  i. ..'on  <••?  trJ.iisg  requirements.  There  were  differences  at  all  levels  of 
•>i ;  itii^aticn,  between  flights,  classes,  stations  and  air  forces.  Some  of  these 
.  vtsCcs,  such  as  those- having  to  do  with  scoring  of  bombing  perform, 
at--..  •.  Jtmaily  had  a  vital  effect  upou  the  scores  of  crews  at  certain  stations. 
Thu5  '  ariatioa  in  conditions  not  only  served  to  attenuate  any  relationships 
!:cn.t-.n  stanines  and  proficiency  criteria,  but  also  may  have  discouraged 
rvia'  -'^s  of  training  personnel  to  develop  better  proficiency  measures,  <iiyr 
i\  Voc-.?  that  any  such  measures  developed  would  probably  be  limited 
in  i-  '  to  the  station  where  they  were  developed. 

f.’i  k  of  interest  in  Proficiency  Measurement 

i  cr  ■*  number  of  leasons  there  was  little  interest  on  the  part  of  many 
u .lining  officers  in  the  measurement  of  proficiency.  Two  of  the  most  im- 
pcf  (ant  rrssons  were  as  follows.  First,  there  was  no  practical  administrative 
procedure  set  up  for  eliminating  individuals  and  crews  thought  not  profi¬ 
cient.  AH  administrative  pressure  was  to  graduate  every  crew  regardless 
of  proficiency,  so  as  to  meet  personnel  commitments  to  combat  theaters. 
A  second  reason  for  the  lack  of  interest  shown  was  the  belief  that  all  of  the 
individuals  reaching  operational  training  had  attained  a  satisfactory  degree 
of  proficiency.  Training  officers  frequently  stated  “all  of  ou^  crews  are 
proficient” 

Problem  of  Control  Groups 

Because  facilities  were  not  available,  the  aviation  psychologists  in  the 
.arious  he.;vy  bombardment  commands  were  unable  to  maintain  a  complete 
file  of  names  of  all  personnel  entering  operational  training,  it  was  thus 
nectary  jn  £ome  rascs  l0  choose  a  control  group  for  comparison  with  an 
experimental  group,  or  o  group  where  a  particular  condition  had  obtained. 
Such  controls  almost  inevitably  turned  out  to  have  been  open  to  some  sort 
of  bias,  operating  either  explicitly  or  implicitly  in  their  selection. 

V/.CJ>IT2T  OF  STAWINjES  and  classification  test  scores 

Taken  by  position,  there  is  no  doubt  that  the  stanines  (B,  N  and  P)  and 
individual  classification  test  scores  better  predicted  the  proficiency  in  op¬ 
era!  rona)  training  of  fighter  pilots  than  they  did  the  proficiency  of  individ- 


uals  of  any  other  flying  specialty.  Validity  coefficients  were  larger  aad 
more  consistently  positive,  both  in  different  samples  of  a  particular  type  of 
score,  and  among  different  types  of  scores.  Three  types  of  proficiency 
measures  might  be  singled  out  as  especially  promising:  gunnery  scores 
(air-to-air  and  air-to-ground),  mission  comments,  and  training  accomplish¬ 
ment  scores.  Stanine  validities  of  roughly  0.15,  0.2$  and  0.25  respectively, 
were  obtained.  While  the  gunnery  and  mission  comment  scores  were 
suitable  for  use  in  evaluation  of  training,  the  training 
scores  were  not  well  suited  for  this  purpose.  Fo**,  if  the  rapid  accomplish¬ 
ment  of  training  requirements  became  a  recognized  goal  and  students  were 
evaluated  in  those  terms,  other  more  important  goals  would  be  neglected. 

Another  important  feature  of  the  validity  data  presented  in  the  fore¬ 
going  chapters  was  the  relatively  poor  success  attained  in  the  prediction  of 
crew  bombing  accuracy.  As  with  other  criteria,  the  fact  that  the  bombing 
scores  were  not  perfectly  reliable  may  have  tended  to  obscure  possible  re¬ 
lationships.  However,  a  second  and  more  important  consideration  was  the 
fact  that  bombing  scores  represented  the  cooperative  performance  of  at 
,  two  and  sometimes  three  aircrew  members.  Thus  the  stanines  and  clas¬ 
sification  test  scores  of  a  single  aircrew  officer  could  not  be  expected  to  ac¬ 
count  for  more  than  a  small  part  of  the  total  variance  in  such  scores.  How¬ 
ever,  attempts  to  predict  the  crew  bombing  scores  by  a  combination  of 
stanines  of  several  crew  members  did  not  yield  promising  results  either. 
Here  it  is  probable  a  number  of  additional  sources  of  error  were  intro¬ 
duced  since  for  only  a  few  of  the  crews  were  stanines  available  for  all  air¬ 
crew  officers.  It  is  not  known  what  selective  factors  were  operating  to 
determine  which  crew  members  were  with  and  without  such  data.  • 

Among  the  various  types  of  criteria  over-all  ratings  and  descriptive  rat¬ 
ings  of  all  sorts  were  in  general  not  well  predicted  by  stanines  of  the  in¬ 
dividuals  concerned.  Somewhat  more  promising  results  were  obtained  for 
the  ratings  of  performance  on  synthetic  trainers.  Link  trainer  scores  of 
various  types  and  CNT  ratings  were  better  predicted  by  the  stanines  than 
most  other  criteria.  Finally,  ground  school  grades  usually  reflected  to  some 
extent  the  stanines  of  the  individuals  concerned.  This  type  of  criterion 
suffers  from  the  fact  that  it  logically  represents  only  a  small  part  (if  any) 
of  the  type  of  actvity  actually  carried  on  in  combat  operations.  The 
“validity”  of  ground  school  performance  is  itself  open  to  question,  when 
the  ultimate  objective  is  the  prediction  of  success  in  combat.  Although  few 
of  the  coefficients  attained  statistical  significance,  it  can  be  pointed  out  in 
summary  that  positive  results  were  obtained  in  most  cases.  Taking  the 
data  as  a  whole,  individuals  with  higher  stanines  had  some  tendency  to  at¬ 
tain  higher  proficiency  scores. 

The  validities  of  individual  aircrew  classification  tests  were  obtained  for 
only  a  few  of  the  criteria  studied  and  for  the  mo.  part  only  with  fighter 
pilots.  No  very  striking  results  were  obtained.  In  general,  the  Mechanical 
Principles  and  Mechanical  Information  Tests  and  t’-c  Biographical  Data 
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best  predicted  success  is  operational  training  (or  fighter  pilots.  While  most 
of  these  validity  coefficients  were  positive,  It  is  interesting  that  no  one 
psychomotor  test  consistently  yielded  validity  coefficients  that  reached 
statistical  significance. 

Two  serious  difficulties  were  encountered  in  validity  studies  in  operational 
training.  The  first  was  the  presence  of  differential  factors  of  selection  with 
respect  to  the  original  testing  population.  In  a  particular  group  of  crews 
-fight  be  included  individual  crew  members  who  belonged  to  testing  pop. 
ulation  as  much  as  two  years  apart  Not  only  had  testing  procedures  and 
tests  been  revised,  but  the  character  of  the  population  tested  h;.d  changed. 
Because  of  the  small  numbers  of  cases  available,  it  was  frequently  not 
possible  to  control  this  factor.  The  second  difficulty  was  that  introduced 
by  extreme  differences  in  level  of  experience  of  aircrew  members  in  a  single 
CCTS  class.  It  is  obvious  that  level  of  proficiency  should  vary  with  amom^ 
of  experience.  Thus,  in  validity  studies  utilizing  populations  of  extreme 
variability  in  experience,  it  would  be  surprising  if  consistent  correlations 
were  found  between  original  classification  test  scores  or  stanines  and 
criteria  of  proficiency. 

The  data  obtained  do  not  permit  a  decision  as  to  what  might  be  the 
optimum  combination  of  various  more  or  less  specific  criteria.  The  degree  of 
correlation  .between  most  of  the  proficiency  measures  studied  was  rather 
high  considering  the  level  oi  reliability  of  the  various  measures, 
whenever  it  was  tried,  the  statistical  combination  of  several  measures  yielded 
validities  not  much  superior  to  th  ose  obtained  with  one  or  more  of  the  sepa¬ 
rate  scores  which  went  into  the  combinatidn.  Most  of  the  rating  procedures 
would  not  lead  one  to  expect  that  a  “clinical”  combination  of  criterion 
scores  would  give  any  higher  coefficients  of  validity  than  did  the  direct, 
statistical  combinations.  It  is  doubtful  whether  sufficient  knowledge  of 
the  interrelationships  of  abilities  exists  to  make  possible  a  successful 
clinical  coubation  of  criteria.  Ideally,  for  combination,  one  would  probably 
desire  a  ’•umber  of  specific  criteria,  each  of  which  measured’  a  different 
aspect  o'  the  total  job  and  the  intercorrelations  of  which  were  low.  Prac¬ 
tically.  this  would  ordinarily  result  in  a  combined  criterion  with  a  low 
degree  of  reliability.  When  there  is  added  to  this  consideration  the  fact 
(hat  the  iviercorrelations,  and  even  frequently  the  reliabilities  of  the. various 
possible  scores,  are  not  well  established  the  decision  as  to  what  criteria  or 
ov.ibinations  of  criteria  should  be  used  in  validation  becomes  a  matter  for 
arbitrary  decision  using  whatever  insight  the  aviation  psychologist  may 
possess. 


SUMMARY 

Aviation  psychologists  .'.'.signed  to  the  various  Continental  Air  Forces 
spent  approximately  a  ye;'  studying  criteria  of  proficiency  in  operational 
training,  determining  vah'Aties  of  classification  test  scores  and  stanines  in 
predicting  success  of  aircr.w  officers  in  such  training,  developing  procedures 
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jof  the  identification  of  potential  lead  crews  and  performing  various  service 
activities  of  interest  to  the  local  commands.  A  relatively  thorough  survey  • 
gas  made  of  available  records  and  procedures  for  evaluating  proficiency 
of  individuals  and  crews  and  additional  procedures  were  developed  In  av  ' 
operation  with  training  departments.  Had  training  continued  another  6 
months,  it  would  probably  have  been  possible  to  put  into  universal  opera* 
tion  some  of  the  more  promising  of  these  procedures.  As  it  was,  only  far 
fighter  pilots  was  there  available  adequate  information  on  proficiency  for 
jither  validation  of  selection  procedures  or  studies  of  effectiveness  of  alter* 
native  methods  of  training.  Finally,  within  the  limitations  of  the  data  these 
jas  a  great  deal  of  evidence  that  individuals  with  high  stanines  tended  to 
reveal  greater  proficiency  in  operational  training  than  did  individuals  with 
low  stanines. 
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.  APPENDIX 


AAF  Letter  20-103, 
Subject:  Aviation  Psychology  in 
the  Continental  Air  Forces 


Appendix  A.1 

„  20-Ha 

Headquarters,  Ann  Ant  Fosca 

'  W/ukinitou,  19  July  Ml. 

AAF  Letter  20-103, 

Subject:  Aviation  Psychology  in  the  Continental  Air  Forces. 

To:  Commanding  General,  Continental  Afar  Forces. 

1.  In  accordance  vitfa  AAF  Regulation  20-59,  aviation  psychologists  will  be  assigned 

to  the  Continental  Air  Forces,  functioning  under  the  technical  supervision  of  the  air 

surgeon.  Continental  Air  Forces  to  carry  out  the  following  functions. 

a.  Making  available  to  commanding  officers  existing  psychological  test  records, 
presidency  test  scorn,  and  training  records,  sad  advising  concerning  the  use  «f 
su*  information  in  the  selection  of  personnel  for  lead  crew  and  other  spedai 
types  of  operational  training. 

b.  Devising  and/or  administering  aptitude' and/or  proficiency  for  the 
purpose  of  securing  additional  information  to  be  used  in  the  selection  of  person¬ 
nel  for  special  training. 

c  Developing  measures  and/or  collecting  data  on  the  proficiency  of  individual 

and/cr  combat  crews  to  be  used  in  evaluating  the  accuracy  of  selection  pe*. 
cedurtft. 

d.  Undertaking  additional  research  studies  that  may  be  directed  by  the  Com- 
manding  General,  AAF  or  the  Commanding  General,  Continental  Air  Fortes. 

2.  Aviation  psychologists  will  be  attached  to  the  surgeons  of  the  several  continental 
air  forces  and  to  the  surgeons  of  such  stations  with  these  air  forces  as  may  be  necessary 
to  cany  out  the  mtrion  indicated  above.  1 

***S“  psychologists  wDl  have  access  to  records  of  proficiency  in  operational 
trabing.  They  w31  be  provided  opportunities  to  gather  supplementary  information  m 

25*  !”l^  aenCy  °f  in  operational  training  in  so  far  as  this  does  not 

interfere  with  the  primary  training  mission  of  the  Continental  Air  Form.  > 

A  \,Co“U,“t*1  F»'“s  »m  submit  to  tit  Corwrrrtrelerig  Gerret* 

f  T°°  “i  DC'  Surgeon.  .  report  * 

monk  ttura.u  of  ivuuoo  psychologists  in  those  air  forces.  Tie  report  for  the  reoefli 

a^.*fr  r  .T*1^  r'POrt°l  "“#"h  l°r  the  prertatfftalyrer. 

This  report  is  assigned  Reports  Control  Symbol  AAF-AS-M-39 

By  Command  or  General  Arnold: 


Coal] 


IRA  C.  EAKER, 

Lieutenant  General,  United  States  Army 
Deputy  Commander,  Amy  Air  Porcet 

6-721,  AK 


I 


appendix  b _ _ _ 

Fighter  Pilot  Mission  Records 
and  Rating  Scales 
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Appendix  B.1 

Student  Mission  Kkxm» 


COSO  (OWE)  .. 


(Instrwcter) 


Directions:  Under  each  applicable  beading  write  specifically  what  the  student  pilot  did 
that  was  either  (1)  Poor,  faulty,  or  doppy  ( particularly  pointing  out  w he*  the  error 
made  endangered  Ms  or  other  pacts’  lives)  or  (2)  Outstanding,  remarkably  good.hr 
far  above  average,  particularly  in  view  of  his  point  in  training.  Do  not  comment 
»ben  the  pilot’s  performance  was  merely  satisfactory,  adequate,  fair,  good  but  not 
muck  better,  or  passable. 

"  ■■■■:.'  '■  . "'■’■-.arr-ir..'.'... . " . ‘ - —  ■  '  ■■  "-Bas  •  '  I 

ADEnuuros  to  Bhotno  iNsnucnocts: 

Basic  Flyino  Tschnique  (Taxi,  take-off,  traffic  pattern,  and  landing): 

Jonr-U»: 

Fouunosr:  . 

Navigation: 

Ackobatics: 

Combat  Manzuvds: 

bmuioom: 

Rawo:  ■  , 

Poltormance  ik  EsracnNcv  Situation: 

Ons: 

(iMSlracttr'i  ImiMi) 


Wfesion  No. 


Appendix  B.2 

Student  Mission  R*co*o 


Date 


Kune .  OSN  . .  Instructor  . 

Directions. — Opposite  each  applicable  item  check  commendation  or  criticism  in  the  ap¬ 


propriate  column. 

Particularly  good  means  outstanding,  in  view  of 
below  standard,  in  view  of  student’s  experience, 
Do  not  check  v/bea  the  pilot's  performance  was 
tood  but  net  much  better,  or  passable. 


student’s  experience.  Weak  means 
merely  sotL  'dory,  adequate,  fair, 
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Appendix  B.3 

’  .  r 

Proficiency  rating  scale  for  trainee  fighter  pilots  at . 

Full  name . . .  Rank.... .  A.S.N . 

n.M .  Total  number  of  flying  hours... . 

Arrival  date .  Departure  date, . 

Directions.  Instructors  in  consultation  with  their  unit  commanders  will  rate  each  of 
their  trainees  on  proficiency  as  a  fighter  pilot.  These  ratings  should  represent  the 
pooled  judgment  of  all  supervisors  who  have  actually  flown  with  the  trainee.  Trainees 
usually  show  greater  proficiency  in  some  aspects  of  flying  than  in  others;  so  the 
ratings  below  should  vary  from  one  item  to  another.  Trainee  pilots  are  to  be  rated  by 
comparison  with  other  men  now  in  training,  or  having  passed  through  in  recent 
commitments.  Recent  graduates  from  Training  Command  schools  (newly-rated  pilots) 
are  to  be  compared  only  with  other  pilots  with  similar  flying  experience.  In  assigning 
ratings  use  should  be  made  of  ail  five  steps  on  the  scale  when  they  are  applicable. 
These  ratings  will  not  be  seen  by  trainees,  will  not  be  entered  on  their  records,  and 
will  not  influence  their  future  assignment  in  any  way.  Instructors  will  not,  at  any 
future  date,  be  taken  to  task,  for  any  ratings  they  may  have  assigned. 


Scale  to  be  used  for  rating  each  item 

i 

(S)  .  Trainee  shows  outstanding  ability  on  this  item ;  is  3S  good  as  best  trainees 

now  in  training. 

(4)  .  Trainee  is  above  average  on  this  item. 

(3)  .  Trainee,  on  this  item,  falls  in  the  majority  or  middle  group  of  pH0*5' 

•  shows  “average"  ability. 

(2)  .  Trainee  is  slightly  below  average  on  this  item,  compared  with  ->tbers  no* 

in  training. 

(1)  .  Trainee  is  weak  on  this  item ;  proficiency  not  yet  up  to  expected  standards. 
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v/  ^  .  it:  w,. 
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#/  tying  prafUkmcp 

(Eacbtk  tW  aoptipiatt  imU  I «r  m%  km  Mo) 

A,  Bask  flying  technique: 

1.  Take-ofl . . . 

2.  Flying  to  traffic  patten  . . . . 

3.  Landing . . . 

4.  Taxiing  . . . 

B.  Formation  flying: 

5.  Joining  formation . 

6.  Maintaining  position  . . . 

7.  Cross-oven  . . . 

8.  Use  of  throttle  . . . . 

9.  Sighting  other  aircraft . . 

10.  Formation  take-of  . 

C  Navigation: 

11.  Preparation  for  missions . 

12.  Pilotage  (orientation)  . 

13.  Speed  and  accuracy  of  corectkras  (of  course,  altitude  and  air* 

speed)  . 

14.  Adherence  to  ETA . . . '• 

B.  IS.  Instrument  flying  (single  over-all  rati  g)  . 

E.  16.  Acrobatics  (angle  over-all  rating)  . .  • 

F.  17.  Night  Flying  (single  over-all  rating)  . . . . 

G.  1*.  Combat  flying  (single  over-all  rating)  . . . 

IL  19.  Radio  procedure  (single  over-all  rating)  . 
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1  2  3  4  S 
I  3  3  4  S 

I  2  3  4  3 
1  2  3  4  3 
1  2  3  4  3 
I  2  3  4  S 
1  2  3  4  3 
1  2  3  4  3 
1  2  3  4  3 


Raimi  of  important  plot  traits 

1.  Eagerness  for  combat  duty  (degree  of  enthusiasm  for  fighting)  ... 

2.  Air  discipline  (dependability;  how  greatly  would  you  desire  to  have 

this  trainee  flying  on  your  wing  in  combat?)  . 

3.  Alertness  (ability  to  learn  quickly,  remember  previous  initrocHona, 

and  keep  “on  the  ball”  while  flying)  . . . . ,.... 

4.  Aggressiveness  (zest  shown  in  acrobrtics,  comhat  flying,  on 

the  deck”  flying)  . . . . . * . 

5.  Headwork  (ability  to  plan  ahead  and  to  foresee  consequences;  does 

trainee  think  while  in  the  air? . . . * . * 

6.  Coolness  (tendency  to  remain  calm  and  unexdted  when  the  un¬ 
usual  occurs)  . 

7.  Conscientiousness  (desire  to  fly  additional  missions  in  the  interest  of 

self-improvement;  does  trainee  study  material  be  nilht  need  in  ad¬ 
dition  to  that  he  must  knovt)  . . * . 

Date  of  this  proficiency  rating  . . . * . . 

Signature  of  instructor  . . . 

Initials  of  unit  or  flight  commander  . . 


1  2  3  4  3 
g  2  3  4  3 
1  2  3  4  3 
1  2  3  4  3 
1  3  3  4  3 
1  2  3  4  3 

1  2  3  4  3 


Remarks 
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Appendix  B.4. 

Proficiency  rating  scale  for  training  filter  pQoU  at  . 

FuO  mpi  . . . . .  Rank . .  ApSJW*. 

ru-  . . .  Total  number  of  flyisf  boon . 

Arrival  date .  Departure  date . 


Directions.  Instructors  in  consultation  with  their  unit  commanders  will  rate  each  of 
their  trainees  on  proficiency  as  a  fighter  pilot.  These  ratings  should  represent  ttt 
pooled  judgment  of  all  supervisors  who  have  actually  flown  with  the  trainee.  Trainees 
usually  show  greater  proficiency  in  some  aspects  of  flying  than  in  others;  so  the 
stings  below  should  vary  from  one  item  to  another.  Trainee  pilots  are  to  be  rated 
by  comparison  with  other  men  new  in  trotnin;,  or  having  posted  through  it  neat 
commitments.  Recent  graduates  from  Training  Command  schools  (newly  rated  pilots) 
are  to  be  compared  only  with  other  pilots  with  similar  flying  experience.  In  assign^ 
ratings  use  should  be  made  of  off  five  steps  on  the  scale  when  they  are  applicable. 
These  ratings  wili  not  be  seen  by  trainees,  will  not  be  entered  on  their  records,  and 
will  D0t  Influence  their  future  assignment  in  any  way.  Instructors  will  not,  at  any 
future  date,  be  tahen  to  task  for  any  ratings  they  may  have  assigned. 


(5) 

(4> 

<3) 

(2) 

(1) 


Scale  to  be  used  for  rating  each  item 

Trainee  shows  outstanding  ability  on  this  item;  is  as  good  as  best  trainees 
now  in  training. 

Trainee  is  above  average  an  this  item. 

Trainee,  on  this  item,  falls  in  the  majority  or  middle  group  of  pilots; 
shows  “average”  abffity. 

Trainee  is  slightly  below  overage  on  this  item,  compared  witn  o men  dot 
in  training. 

7\-alnee  is  weak  on  this  item;  proficiency  not  yet  up  to  expected  standards. 


A. 


Ruling  of  flying  proficiency 
[Encircle  the  appropriate  lumber  for  each  item  beknr.J 
Form  /  m  flying  ' 

j  '.aintai’.  ng  position  . . .  1 _ 2_ 


J  4  S 


j. 


C. 


D. 


E. 


Use  of  throttle . ' .  1  .2341 

3.  Sighting  other  planes . 1  2  3  4  S 

4.  Formation  at  high  altitude .  1  3  3  4  3 

Joining  Formation: 

o.  Joining  as  quickly  as  possible  . ..I  3  3  4  3 

6.  Getting  into  and  maintaining  a  correct  position  . I  2  3.4  3 

Maneuvers: 

7.  Doing  maneuvers  difficult  to  follow  . . .  12  3  4  3 

8.  Doing  tight  turns .  1 _ 2  3  4  3 

Gunnery  Pattern: 

9.  Position  before  starting  pass . . .  1  2  3  4  3 

10.  Curve  of  pursuit .  2  3  4  j 

11.  Rejoin  . 

Aeriai  Gunnery: 

12  Firing  in  range  . I  2  3 

13.  Line  of  right  . . 

Ground  Guiuery: 

14.  Pattern  . '■ .  L_LlLJl4 

13.  Firing  ii  range  .  }  2  3  ±J 
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1  2  3  4  3 


-  a* 


Rating  0/  Important  p8at  Uato 

I.  Eagerness  for  combat  duty  (degree  of  estbtuiasm  for  fighting)  ... 

I  Mr  discipline  (dependability ;  how  greatly  would  you  desire  to  have 
this  trainee  flying  on  your  wing  in  combat?) . 

j.  Alertness  (ability  to  learn  quickly,  remember  previous  instructions, 
and  keep  “on  the  baU*  while  flying)  . 

4,  Aggressiveness  (test  shown  in  acrobatics,  combat  flying,  jud  "am 

the  deck”  flying)  . . . 

5,  Htadwark  ^ability  to  plan  ahead  and  foresee  consequences;  docs 

trainee  tkink  while  in  the  air?)  . 

6,  Coolness  (tendency  to  remain  calm  and  unexdted  when  the  unusual 

occurs)  . . . . . . 


Conscientiousness  (desire  to  fly  additional  missions  in  the  interest  of 
self-improvement;  does  trainee  study  material  he  aught  need  fas  ad¬ 
dition  to  that  he  mutt  knew?)  . . . . . 

Date  of  this  proficiency  rating  . . 

Signature  of  instructor  . .. . . 

Initials  of  unit  or  flight  commander . 


APPENDIX  C 


B-29  Airplane  Commander 
Questionnaire 


Ayptrfr  Cl 

>-»  A Bust  Cantmn  Qcmnauai 


H»fR]tiMMRkb(ii(fikd  oat  far  tie  Xcsaid  Section  of  tie  Third  Air  Tmtr. 
Ib  pmpaae  b  to  pk  a  better  idea  as  to  what  the  B-29  Airplane  Cswauda  does  af 
docs  aot  ddikb  rrfarie*  with  has  err*.  It  wr*  also  serre  as  a  grade  for  the  Air  Ffeot 
io  pirparirg  fatnre  cocoes,  checks  aad  aids  far  the  B-29  Aupbae  Csowwawdec. 

The  gertfir— sift  it  io  oj  wnjr  to  be  ccawdrted  t  test  or  aa  rariiritim.  There  at 
oo  right  or  mot  aowous  to  the  tpodooL  The  ooljr  right  aaswer  it  the  eoe 
appfas  to  jm  or  best  describes  par  actioi. 

The  anas  jroc  (IK  *d  ia  so  s«y  sirct  year  preseat  states  aor  a3  it  hear  nr 
bearing  apci  jar  present  or  fstor  stanr&ag  as  an  airplane  coaooaader.  The 
of  the  mertrii'n  ai  not  be  pveo  to  the  tialiaag  or  dbedocia]  junnowrl  of  this  hose 
bat  «3  be  used  oaiy  by  the  Third  Air  Forte  Sesearsh  Sectk*.  Its  porpoor  »  to  pda 
■hosCbs  aboot  aad  a  better  wodrrffiwlog  c-  the  airpfane  acnudrr’i  problem. 

Brofahtr,  there  are  ao  right  or  wrong  iricn.  The  owiy  right  answer  is  the  oat 
that  best  «hscrt>es  yoor  wtostiow  or  « 


Ocr  one}  (fir*  N.)  (IO)  USO  (lot) 


Wi&mMme)  idea  •nicr)  (jrodrsaoo 


CTrtrf  Wi)  (r«toT  tows  P-3*) 

Fonser  |jnf  autmetor:  Yes .  No . If  in  what  type  ah- 

. length  of  time  as  iastrador  (jaw  sod  Beads) . . 

Com  bet  experience:  Yes . No . If  “yes,"  £3  ic  the  follow*: 

Theater . 

Type  aircraft  flows  Io  combat . 

Number  Missions .  (or  boctj . ). 

AanAsi  Commas!**  Ianrzsrrocr 

I*  Have  you  witnessed  nr  beard  any  dissensos  among  your  crew  members  during  tie 
past  week? 

.  *-  Have  witnessed  or  heard  considers)}]'  dissension  ia  the  past  week. 

......  b.  Have  witnessed  or  beard  some  crew  dissenson  in  the  past  week. 

. -  (-  Have  witnessed  or  beard  no  crew  dissension  in  the  past  week. 

2  How  much  off-duty  time  have  you  spent  with  your  officer  crew  members  during 
the  past  week? 

• .  *-  Have  spent  as  much  time  as  possible  on  off-duty  k.ura  with  olScer 

crew  members  during  the  past  week. 

.  b.  Have  spent  considerable  off-duty  time  with  officer  crev  members  dor- . 

ing  the  past  week. 
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c  Hm 


•f-dnCy 


L  D.  yw« 


4.  Hare  gwt  wjr  Stile  of -dwty  tm 
k{  tk  put  week. 

t  Hare  ***t  at  oM -dwty  tine  with 
put  week. 

fed  k  k  lapwlnt  ul  donUt  to  a 


.  a.  Fed  k  k  ofmdjr  important  aad  do  so  at  every  «ppa 

.  k.  Fed  k  if  iaepartaat  aad  agodate  wkk  tom  a  peat  dd 

. .  c.  Fed  it  »  of  5&e  topomaa  aad  asaodatiow  sbodd  be 

_ _  dL  Fed  k  is  somewhat  detrimental  aad  sack  aatodatiow  she 

4.  Cfceck  opposite  the  poskioas  fisted  betow  toe  crew  amben  who*  1 


Nniptir. 


...  L  Xafi 

...  *■  W* 

...  h.  Left 
...  L  Tai 

...  i-  **■« 

to  jnoer  crew 


.  dL  Radar  operator.  .  L  Taw  garnet. 

1  fiare  jw  fdSled  al  pnema  jroo  have  wade  to  jrowr  crew  during  trambg  at 
toit  box? 

.  a.  Hare  fdSQed  al  pccessss  IVe  aide  to  say  dew. 

.  b.  Have  asnaHjr  fulfilled  promises  wade  to  my  crew. 

.  e.  Store  gtaaociBy  fulfilled  promises  IVe  amde  to  ajr  crew. 

.  <L  Have  sad:  no  premises  to  ajr  crew. 

<l  Do  yon  fed  k  is  desirable  to  associate  sodaFy  with  toe  enlisted  members  al  yo«r 
crew? 

.  a.  Fed  k  is  desrable  to  associate  sodaly  with  eafisted  member*  of  my 

crew  aad  do  sc  fceqwewliy. 

.  b.  Fed  it  is  desrabSe  to  associate  socially  with  eafisted  members  of  my 

crew  aad  do  so  occasowaly. 

.  c_  Fed  it  is  desirable  to  associate  sodaEy  with  eafisted  members  of  my 

crew  bet  do  aot  dc  so. 

.  <L  Fed  it  is  cct  desirable  to  associate  sodaly  with  enfirted  crew  mem¬ 
bers  bat  do  so  frequently. 

.  c.  Fed  it  is  not  desirable  to  associate  socially  with  eafiked  oew  mem¬ 
bers  bet  do  so  occuicnaBy.  • 

f.  Fed  i;  is  uot  desirable  to  asrodate  socially  with  minted  aew  members 

zb d  refrain  from  doing  so. 

7.  How  have  you  dealt  with  problems  involving  aew  (fifficnKirs  or  mcompatftilities 

daring  your  training  at  this  base?  ...  .  - _ 

a.  Have  turned  over  to  higher  authorities  all  difficulties  which  have  arisen. 

b.  Itove  turned  over  to  higher  authorities  only  those  problems  and  diffi- 

euities  which  I  have  been  unable  to  coned  wysdt 
c  Have  been  unable  to  solve  some  difficulties  mysdf  but  have  not  tamed 

them  over  to  b'cner  authorities.  _  _ 

j  Have  suspect t  problems  and  difficulties  existed  but  did  not  investi¬ 
gate  further  thinking  they  would  solve  themselves. 
t  i  am  certain  no  problems  or  difficulties  have  occorred  with  my  crew. 

8.  Is  there  a  "trouble  maker”  on  your  crew? 

•  ••«••  Yes. 

J  .  b  No.  If  "yes."  describe  in  what  way  be  cau.es  trouble . 
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«.  D*  ym  fed  k  b  desirable  to  haw  dtoaen  or  soda!  engagements  at  which  rath 
arm  (both  olficm  aad  enlisted  men)  b  present? 

u  YcA  jocJai  engagements  for  entire  crew  are  desirable  aad  should  U 
held  frequently. 

b.  Fed  aadal  engagements  for  entire  crew  are  desirable  aad  should  W 
m  u i  udonllj 

_ _  t  frd  aodel  engagements  for  entire  crew  are  somewhat  desirable  b« 

should  be  held  very  Infrequently. 

d.  Fed  social  engagements  for  entire  crew  are  detrimental  aad  neb  t*. 
gagements  should  not  be  bdd. 

ia  Haro  any  of  your  crew  members  been  Involved  in  disciplinary  action  (U,  oStid 
mp rfauad  by  aa  officer  who  b  not  a  member  of  your  crew;  A.W.  104;  courts  an. 
ri«i)  during  your  training  at  this  best? 

Hate  or  more  crew  members  have  been  involved  la  disciplinary  actio* 
during  our  training  at  this  bast. 

b  Two  crew  members  have  been  involved  in  disciplinary  action  doting 
our  training  at  this  base. 

c  one  crew  member  has  been  involved  in  disciplinary  action  during  oar 
training  at  this  base. 

d.  No  crew  member  has  been  involved  in  disciplinary  action  during  o«r 
training  at  this  bare. 

11.  After  hA  of  the  past  four  missions  have  you  discussed,  reviewed  or  critiqued  with 
your  crew,  errors  or  problems  which  occurred  during  the  mission? 

».  Ye#:  bdd  a  critique  after  each  of  the  past  four  missions. 

.  b.  Y«;  held  a  critique  after  three  of  the  past  four  missions. 

.  t  Yes;  held  a  critique  after  two  of  the  past  four  missions. 

.  d.  Yes;  bdd  a  critique  after  one  of  the  past  four  missions. 

.  e.  Have  hdd  no  critique  after  the  last  four  missions. 

12.  In  your  critique  of  a  mission  do  you  usually: 

.  a.  Talk  to  the  entire  crew  as  a  group. 

.  b.  Talk  with  some  but  not  all  crew  members  as  a  group. 

.  c.  Talk  with  individual  crew  members  only. 

.  d.  Do  not  hold  a  critique. 

U.  In  the  last  4  personal  equipment  inspections  of  your  crew  did  you  usually: 

.  a.  Make  a  thorough,  detailed  inspection  of  all  crew  members. 

......  b.  Make  a  thorough  inspection  for  only  certain  crew  .members. 

c.  Make  a  rapid  and  superficial  inspection  of  all  crew  members. 

.  d.  Fail  to  make  a  personal  equipment  inspection. 

14.  Have  you  designated  to  individual  crew  members  responsibilities  and  duties  ia 
addition  to  those  ordinarily  required  for  the  performance  of  their  assigned  positions? 

.  a.  Yes;  to  a  very  few  crew  members  (1  or  2). 

.  b.  Yes;  to  some  crew  members  (3,  4  or  5). 

.  c.  Yes,  to  half  or  more  (6,  7  or  8). 

.  d.  Yes,  to  most  crew  members  (9  or  10). 

.  e.  No;  have  not  designated  additional  duties  and  responsibilities  to  *”7 

crew  members. 

U.  To  whom  do  your  crew  members  bring  their  personal  problems? 

.  a.  To  you  as  the  airplane  commander. 

.  b.  To  the  copilot 

.  c.  To  the  bombardier  or  navigator. 

.  d.  Other  (name  by  position . ). 

.  t.  Personal  problems  are  brought  to  no  crew  member’s  vttentlon  in  P1* 

ticulsr, 
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li.  When  >«ts»i7  to  correct  a  crew  member  regarding  tiw  pcrfonauct  of  Us  datin 
do  you  generally: 

•  •••*■'  *•  Take  up  the  matter  immediately  regardless  oi  puct  or  time  of  occur* 
rente. 

.  k-  Tkke  up  the  matter  at  a  time  when  the  majority  of  the  atw  are 

present 

.  c.  Have  a  private  talk  with  the  crew  member  involved. 

.  4  Have  had  no  occasion  to  correct  a  crew  member  regarding  the  per* 

form  ante  of  his  duties. 

• 

17.  Do  you  keep  personal  records  of  individual  proficiency  of  all  crew  members? 

.  a.  Keep  adequate  records  of  all  crew  members. 

.  b.  Keep  incomplete  records  which  are  usually  sufficient  for  my  purpose. 

.  c.  Keep  records  but  they  are  not  very  good. 

.  d.  Would  like  to  keep  records  but  have  been  too  busy  to  do  so. 

.  e.  Do  not  keep  records. 

.  f.  Do  not  keep  records  and  do  not  tblnk  records  are  necessary. 

IS.  Below  is  a  list  of  sources  from  which  you  can  learn  about  the  proficiency  of  your 
crew  members.  Check  as  many  of  -hese  sources  as  you  have  used  during  your 
training  at  this  station: 

.  a.  Ground  school  records  (engineering,  grades,  diss  records)  - 

.  b.  Trainer  records  (A-S,  supersonic,  etc.) 

.  c.  Flight  records  (logs,  mission  reports,  etc) 

.  d.  Instructor  opinion. 

.  e.  Talking  with  crew  members. 

.  f.  Observing  crew  members  at  wo  A. 

.  g.  Other,  describe  '• 

.  h.  Have  checked  none  of  the  above. 


19.  When  you  receive  extra  or  incidental  information  (from  other  than  classroom 
sources)  which  is  related  to  or  would  assist  in  the  training  of  your  crew,  do  you 

.  a.  Pass  it  on  to  the  entire  crew  during  a  “bull  session"  or  crew  meeting. 

.  b.  Pass  it  on  to  the  crew  member  to  whose  job  the  information  is  most 

closely  related. 

.  c.  Keep  the  information  for  your  own  personal  use. 

20.  Prior  to  a  mission,  do  you  give  to  your  crew  instruction  and/or  orientation  to 
addition  to  that  given  at  briefing? 

.  a.  Always,  give  additional  instruction  and/or  orientation  to  crew  prior 

to  a  mission. 

.  b.  Nearly  always  give  additional  instruction  and/or  orientation  to  crew 

prior  to  a  mission. 

.  c.  Frequently  give  additional  instruction  and/or  orientation  to  crew  prior 

to  a  mission. 

.  d.  Occasionally  give  additional  instruction  and/or  orientation  to  crew 

prior  to  a  mission. 

e.  Seldom  give  additional  instruction  and/or  orientation  to  crew  prior  to 
a  mission. 

f.  Do  not  give  additional  instruction  and/or  orientation  to  crew  prior  to 
a  mission. 

21.  In  regards  to  giving  your  crew  briefing  and/or  instruction  additional  to  that  given 
in  regular  briefing,  do  you  feel 

.  a<  You  should  always  give  additional  briefing  ar  !/ or  instruction. 

b.  You  should  frequently  give  additional  briefing  and/or  instruction. 
c'  you  should  occas:  .ially  give  additional  briefin;  and/or  instruction, 
d.  you  should  never  give  additional  briefing  and/  .nstruction. 
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22.  Select  the  stitenest  below  wbkh  beat  describes  the  radioes  and  storage  of  cq^. 
meat  prior  to  take-of,  oa  your  bit  four  missions. 

.  a.  AB  equipment  wu  ready  and  properly  stowed. 

.  b.  AB  equipment  was  present  but  col  properly  stowed. 

......  e.  Not  an  equipment  wu  ready  but  that  which  was  ready  wu  prepay 

stowed. 

.  d.  N  s  check  was  made. 

23.  When  you  have  extra  “waiting  time"  between  briefing  and  take-off,  do  you 
.  a.  Utifise  this  “waiting  time”  by  instructions,  practice  of  training  proa. 

dure,  and/or  discussions  of  some  phase  of  training. 

.  b.  Utilise  this  “waiting  time”  by  holding  informal  “bull  sessions"  in  wUd 

entire  crew  participates. 

.  c  Keep  all  the  crew  in  the  vicinity  of  the  plane  unless  I  uwdlcsBy 

authorize  them  to  leave  but  do  not  utilize  this  “waiting  time." 

.  d.  Allow  each  crew  member  to  choose  his  own  activity  until  it  b  tfe 

to  take-off. 

24.  When  crew  members  faS  to  use  correct  interphone  procedure  do  you 
.  a.  Correct  the  error  immediately  when  it  occurs. 

.  b.  Wait  until  you  are  on  the  ground  to  correct  the  error. 

.  c.  Never  bother  to  correct  the  error,  because,  on  the  whole,  the  crew's 

procedure  is  superior. 

.  d.  Allow  the  error  to  pass  uncorrected  because  in  most  cases  it  is  a  dp 

that  win  be  corrected  with  additional  practice. 

.  e.  Never  pay  attention  to  the  error  so  long  as  the  message  is  heard  dearly 

and  distinctly. 

23.  During  flight  do  you 

.  a.  Make  frequent  combat  crew  position  reports. 

.  b.  Occasionally  call  for  combat  crew  position  reports. 

.  c.  Seldom  edi  for  combat  crew  position  reports. 

.  d.  Do  not  call  for  combat  crew  position  reports. 

26.  On  the  last  four  missions  have  you  practiced  emergency  procedures  where  possible 
whether  specifically  called  for  by  mission  requirements? 

.  a.  Yes;  on  aS  four  missions. 

.  b.  Yes;  on  three  of  the  last  four  missions. 

.  c.  Yes;  on  two  of  the  last  four  missions. 

.  d.  Yes;  on  one  of  the  last  four  missions. 

.  e.  No;  not  on  any  of  the  last  four  missions. 

27.  Do  you  check  to  see  that  all  equipment  is  kept  in  an  orderly  manner  during  flight? 
v . . . .  a.  I  make  frequent  checks  to  see  that  all  equipment  is  kept  in  an  orderly 

manner  during  flight 

.  b.  I  occasionally  make  checks  to  see  that  all  equipment  is  kept  in  is 

orderly  manner  during  flight. 

......  c.  I  seldom  make  checks  to  see  that  all  equipment  is  kept  in  an  orderly 

manner  during  flight. 

.  d.  I  do  not  check  to  see  that  all  equipment  is  kept  in  an  orderly  manner 

during  flight 

28.  Do  you  require  crew  members  to  report  and/or  record  important  land  observation! 
made  during  flight  (e.g.,  villages,  airfield  with  type  of  plane  on  field,  factories,  or 
industrial  areas). 

.  a.  Require  crew  members  to  report  and/or  record  a!’  land  observation* 

during  flight 

.  b.'spcdfy  to  crew  what  type  of  land  observations  which  art  to  be  it* 

ported  and  do  not  require  them  to  report  anything  else. 

.  c.  Do  not  require  crew  to  make  or  report  land  observr. ions. 
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j*.  Wiick  «i  the  faBowiag  iManu  danddu  yew  procedme  WM|  At  ctw> 
pletiow  of  the  Hsl  4  «r  S  Bfafav? 

.  l  Held  t  crkiqwe  with  every  acv  waht  yaat 

.  b.  HtM  t  critique  with  Ik  majority  tf  acv  mtm bw  promt. 

.  t  Held  x  critique  ivfividualy  with  mt  of  the  acv  mka 

.  d.  Hdd  *  critique  oaiy  with  UMfub  «W  made  men 

.  e.  U«Ily  fck  so  critique  was  uectsmsy. 

30.  Which  of  tbe  following  rta« events  beat  docribe  yow  attitude  ad  pndkt  uhtfw 
to  oikUidiit  full  adbotaa  to  ndcs  tod  icpfatigw  |md^  At  octet  tad  ' 
actions  of  aStary  personnel. 

.  a.  Require  strict  adherence  at  al  times  io  tbe  air  aad  oa  Ac  grawad. 

.  bu  Require  strict  adherence  at  al  times  ia  tbe  air  aad  ■adrruti  oa  the 


.  c  Strict  adherence  at  au  data  ia  tbe  *k  bat  fed  adbereace  aa  the  gsnnad 

aot  essential. 

.  <L  Feci  moderate  oAcrcacc  both  ia  Ac  tit  aad  oa  tbe  ground  la  ai  that 

is  necessary. 

.  e.  Fed  that  neither  moderate  or  strict  adherence  is  nerrmry  be  training 

vfaOe  in  this  country. 

3L  Upon  the  completion  of  a  suctemfti  mheioa  da  yon  4 

.  a.  Give  praise  to  the  crew  as  a  whale. 

.  b.  Give  praise  to  those  imfividnals  whose  work  vas  aatstaadfeg 

.  c.  Infrequently  give  praise  because  I  feel  it  does  no  geo*. 

.  d.  Never  pve  praise  because  I  led  R  is  iVtrimcntsI 

32.  Whkh  of  the  following  statements  best  describe  the  way  tbe  eafisted  acv  mem¬ 
bers  usually  address  you? 

.  a.  First  name  or  nickname  (such  as  Bi,  Joe,  Red,  etc.) 

.  b.  Enlisted  crew  members  address  me  by  aey  last  name  oaiy  tmeh  aa 

Brown,  South,  etc) 

.  c_  Enlisted  crew  members  address  me  by  my  rink  only  (so*  as  lew- 

tenant,  captain,  major). 

.  d.  EnhsUd  crew  member*  address  me  as  “dr,”  or  by  osmy  my  rank  and 

name  (such  as  Linlmut  Brown,  Captain  Smith,  Major  Brown,  etc) 

33.  Which  of  the  following  statements  best  deserve  the  way  the  officer  acv  members 

usually  address  you?  ,  •  _ _ 

.  a.  Officer  crew  members  address  me  by  my  first  name  or  a  dtiwm 

(such  as:  Joe,  bill.  Red,  etc.). 

.  b.  Officer  crew  members  address  me  by  my  last  name  only  (sock  as 

Brown,  Smith,  Jones). 

c  officer  crew  members  address  me  by  rank  only  (soch  as  Beotcnaaft, 
captain,  major,  etc). 

d.  Officer  crew  members  address  me  as  ‘‘sir,’*  or  by  using  my  rank  and 
name  (such  as  Lieutenant  Brown,  Captain  Smitk,  etc). 

34.  Have  you  spent  extra  time  in  the  past  week  with  any  crew  member  in  helping  Urn 
increase  his  proficiency  ? 

. -a.  Have  had  no  occasion  to  do  so. 

b.  Have  not  had  any  time  to  assist  crew  members. 

......  c.  Have  helped  one  or  two  crew  members. 

d.  Have  helped  three  or  more  crew  members. 

35.  Do  vou  feel  that  an  airplane  commander  should  admit  his  mistakes  to  his  crew? 

a.  Yes;  bis  mistakes  should  be  bandied  in  the  same  manner  as  the  mis¬ 
takes  of  any  of  his  crew  members. 


i 
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c.  Yes;  W  ihsaH  iM  hb  afauko  bat  a  p«p»  excuse  tMj  W  ^ 
M  that  lha  prestige  of  the  ptane  comaaander  wiS  not  be  alerted  by  ^ 


M.  Check  tie 

log  at  thickest 


d.  Bm  tidy  always  asked  crew 

ipMiw 

e.  Hare  always  asked  crew  members  for  questions,  suggestions,  a mi/m 


3t  Hare  you  kad  your  crew  members  cringe  positions  during  (fight  in  order  to  ft 
experience  la  other  flight  positions? 

.  a.  Hare  bad  uB  crew  members  change  positions  at  least  once  and  mad 

bare  changed  postiora  several  times. 

.  b.  Frequently  hare  crew  members  change  positions  when  it  does  not 

interfere  with  the  execution  of  the  aihaca. 

.  c  Occasionally  hare  crew  members  change  positions  when  it  does  mt 

interfere  with  the  execution  of  the  mission. 

.  <L  Seldom  have  crew  members  change  positions  when  it  does  not  interior 

with  the  execution  of  the  mwaou. 

.  e.  Hare  not  had  are  members  change  positions  but  they  hare  done  is 

of  their  own  accord. 

.  f.  Have  not  had  any  interchanging  of  positions  on  my  crew  as  I  fed  it 

has  not  been  necessary. 

39.  Would  you  request  the  transfer  from  your  crew  any  man  who  {check  any  that 

«w*r>. 

.  a.  Questioned  your  authority. 

.  b.  Was  a  source  of  crew  dissension. 

.  c  Was  absent  too  frequently  (even  though  the  reason  for  his  absence  k 

justifiable). 

.  d.  Did  not  do  his  share  of  the  crew’s  work  in  preparing  for  a  flight  and 

returning  equipment  after  the  flight 

.  e.  Was  not  proficient  in  his  specialty. 

.  f.  Was  objectionable  because  of  his  personality. 

40.  What  is  the  most  difficult  aspect  of  your  job  as  an  Airplane  Commander?  Wdt* 
your  answer  below: 
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appendix  d. 


MUP« 
0m.  S 

MU’*  a 


IMU 
•  45) 


Pilot’s  Rating  Sheet 


Appendix  D.1 

Pitort  Xum  'zsr 

Crew  Ho. .  Main  No. .  Date 


Under  “Ratio*"  place  the  appropriate  grade  (5,  4,  3,  2,  or  I)  width  yom  fact  ndn* 
cuatcly  describee  the  pOot  according  to  the  following  rating  scales:  Emptlo— 1  f{ 
Abort  avenge,  4;  Avenge,  3;  Below  avenge,  2:  Po or,  1.  . 

Then  circle  the  letter  (a,  b,  (,  etc)  preceding  those  dons  which  have  influenced  Jtm 
{a  your  determination  of  a  grade,  bearing  in  mind  that  yen  should  compare  Una  win 
conception  of  the  Ideal  lead  arw  pBot. 


b.  i/xi* — pilot  cover* 

c.  Interior  cleaniiseM. 
a  Proonzl  remark*: 

*.  Initiative . 

t.  Crew  respect . 

c.  Attitude . 

d.  Personality . 
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Scale  of  Instrument  Flying 

Skin— HB(B-17) 


Appendix  E.1 


Scale  or  IxsnvMDrr  Flying  Skill— HB(B-17) 
(Experimental  Form) 


Directions  for  using  the  scale.  In  order  to  achieve  standardised  measurement,  it  Is 
f^sential  that  directions  be  followed  closely.  Elements  for  cadi  maneuver  are- listed. 
Check  pilots  will  make  sure  pilot  understands  all  the  elements  of  a  maneuver  before  be* 
ginning  it,  otherwise  variations  in  testing  will  occur. 

Turbulence  may  have  a  marked  effect  upon  a  pilot’s  execution  of  a  maneuver.  Check 
pilot  win  record  his  estimate  of  the  amount  of  turbulence,  but  wiH  base  Judgment  of  pro* 
fidency  on  behavior  of  pilot  at  times  when  turbulence  b  not  effective.  Insofar  as  pot* 
able,  the  profidency  grade  should  not  be  influenced  by  turbulence.  By  light  turbu* 
lectc  is  meant  that  the  air  u  slightly  rough  but  not  rough  enough  to  influence  the  pilot’s 
performance.  Moderate  turbulence  is  when  the  air  is  rough  enough  that  the  pilot’s 
performance  of  the  maneuver  is  affected  but  the  effect  of  the  turbulence  can  be  sub¬ 
tracted  in  evaluating  the  performance.  Heavy  turbulence  is  when  the  air  b  so  rough  that 
its  effect  on  the  pilot’s  performance  cannot  be  estimated  and  the  entire  check  on  the 
given  maneuver  should  not  be  used. 

Proficiency  in  control  of  deviation  is  to  be  measured  by  indicating  that  type  of 
correction  used  by  the  pilot  during  a  specific  time  interval  during  a  maneuver.  Dif¬ 
ferent  characteristics  of  the  flying  will  be  observed  during  different  time  intervals.  One 
of  the  following  types  of  correction  is  to  be  recorded  for  each  characteristic: 

a.  Failure  to  attempt  correction  of  a  deviation. 

b.  Oscillating  over-correction  or  over-correcting  in  both  directions  resulting  In  an 

oscillating  deviation.  '  ‘ 

c.  Simple  over-correction  in  recovery  which  sets  up  a  deviation  in  the  opposite  direc¬ 

tion;  and  Simple  under-correction  in  which  the  original  deviation  Is  never  entirely  re¬ 
moved.  * 

d.  Perfect  flying— no  deviation  occurring  during  interval 

Example.  Spiral  Climb.  Performance  of  the  pilot  during  climb  will  be  measured  dur¬ 
ing  first  45  seconds  after  instructions  on  maneuver  are  given,  using  following  sequence: 


Instruction 

completed 


First  Secoed 

IS  seconds _  IS  seconds 

No  measurement  Bari  deviation 


Third 
IS  tecoods 
Climb  altitude 


Climb 

Completed 


During  second  15-second  period,  Bank  deviation  only  is » to  be  evaluated  Th«i  type 
of  correction  used  by  the  pilot  most  of  the  time  during  this  15-second  period  b  to  U 
ucordcd.  For  example,  if  the  pilot  uses  oscillating  over-corrections  most  of  the  15- 
sccond  period,  oscillating  over-correction  will  be  checked  in  recording  the  pilots  per- 

f°™rilJ**thc  third  15-second  period,  Climb  attitude  deviatior  only  Is  to  be  evaluated. 


That  type  ot  correction  used  by  the  pOot  during  his  iS-secoad  period  la  malauialag  tbt 
coned  attitude  wiB  be  vied  evaluating  bis  performance. 

Proficiency  evaluations  u  described  above  will  be  tasde  of  deviation*  ia  besdhw. 
airspeed,  altitude,  rate  of  ton,  rate  of  climb,  and  rate  of  tilde.  Deviations  in 
attitude,  gBde  attitude,  and  bank  wiQ  be  measured  on  the  flight  indicator  only. 

Maximum  dentations  will  also  be  recorded  for  some  characteristics.  This  «etre  u  *« 
be  the  largest  deviation  occurring  in  that  interval  during  whkh  the  given  characteristic 
was  bring  observed.  Deviations  occurring  at  other  times  than  during  the  specified  inter, 
val  are  not  to  be  recorded. 

Degrees  •/  heading  error.  During  turns  and  g'ldes  the  initial  and  final 
be  recorded  in  order  to  obtain  the  degree  of  err  r  in  perfomnnee. 

Check  pOot  will  score  proficiency  of  pflot  a.  completion  of  each  maneuver.  WV4 
possible  at  this  time,  pOot  win  be  instructed  to  fly  straight  and  level  until  scoring  k 
completed  and  next  maneuver  is  described.  To  score  proficiency,  place  a  check 
in  the  appropriate  space  for  each  measure  of  the  maneuver.  The  check  pflrt  wifi  SB  fo 
the  following  information  before  the  flight  begins: 

POot'sname .  Ranh .  ASN  . . 

Number  of  graduating  class  in  Training  Command .  Hours  in  B-17 

Motb  status:  Trainee .  Flying  Inst .  Administrator  * 

Ground  tat . ’...1...!.. 

Check  pilot’s  name .  Rank . . 

Date . . .  lime  of  day  check  began  . . . . . 

On  completion  of  flight  check  pOot  wifi  fill  in  the  following: 

Time  of  day  check  ended; 

Over-all  rating  of  pilot’s  instrument  flying  AM* 

Excellent  .  Good  .  Poor  . 

{10%  of  path)  {Majority  of  pilots)  ( 10%  0f  pilots) 

1.  Instrument ' akt-of : 

Directions  to  check  pilot.  Align  the  airplane  with  the  runway.  With  the  pflot  listen¬ 
ing  in,  contact  the  tower  and  obtain  and  record  the  direction  of  ary  cross  wind  and  the 
speed  of  the  wind. 

Cross  wind  at  takeoff:  Direction . ®  Speed . m-pli. 

Runway  reading . . «, 

Instructions  to  pOot:  Set  directional  gyro  to  nearest  5°  indfce  of  runway 
and  take-off. 

Rate  of  gaining  directional  control: 

Gained  directional  control  quickly .  > 

Gained  directional  control  in  average  time  ...’. . . 

Gained  directional  control  slowly . 

Altitude  at  precise  moment  that  speed  of  140  MPH  is  first  attained . ..feet 

Assistance  on  take-off  run: 

No  assistance  given . 

Assistance  by  words  or  signs .  v 

Assistance  by  movements  of  any  controls . 

2.  Spiral  climb  to  right  for  1,000  feet,  fly  straight  for  30  seconds  and  climb  to 
left  for  1,000  feet 

a.  Bank  IS0. 

b.  Airspeed  150 

c.  Rate  500  ft.  per,  min. 

Check  Pilot  will  have  pflot  put  plane  on  a  round  numbered  altitude  e.g.,  1,000,  2,000, 
3000,  etc.,  and  will  inform  pilot  of  the  altitude  1,000  feet  higher  at  which  the  climb  is 
to  be  completed.  At  end  of  right  climb  and  before  beginning  left  climb  pflot  is  to  flj 
straight  for  about  30  seconds  Altitude  at  end  of  each  climb  is  taken  at  that  moment 
wings  are  made  level  regardless  of  climbing  attitude  of  pVnt 


» -fc  --  'ta-ifi 


Monk  deviation  and  CUmb-ttikude  deviation,  are  tad  U  be  obeemd  dsriaf  ydM 
fifteen  (15)  second  iatetvtit  is  the  following  sequence: 

ft*  S«w4 

tutrxtbea  Haeroh  ITnrrifc  |Ji 

Cb®p5*M<  N«  mwwac  SsStofaSE  SggggS" 


Maximum  deviations  iie  to  he  recorded  for  etch  characteristic  for  the  specified  I** 
teml  o*rfy,  using  the  flight  indicator.  Deviations  in  bank  ar?  to  be  measured  in  degrees 
from  the  original  bank  set  up  by  the  pilot  Deviation*  k  cfiab-attftude  an  to  bo 
measured  to  terms  of  the  linear  distance  that  the  horizon  fine  fluctuates  from  the  original 
postion  set  up  by  the  pilot 

Might  turn 

Altitude  at  beginning  of  right  tons . ft  - 

Altitude  at  moment  wings  are  first  nude  Jerri . ..  ft 

Bank  deviation  (2d  15-second  interval  only — check  one):  ' 

Failed  to  correct . 

Qsdflattog  over-correction . . 

Simple  over  or  under  correction  ......... 

Perfect  flying— m  deviation  occurred  . . 

Maximum  deviation — tank  (Check  one): 

*  2°  limits  . . 

dt  4^  Hmit*  ......... 

dt  6°  ifmlt*  . . 


Over  ±  6 9  limits  ......... 

Climb  attitude  deviation  (3d  iS-oecowS  interval  only- check  one): 
Failed  to  correct 


Oscillating  over -correction  . . 

Simple  over  or  under  correction  ......... 

Perfect  flying — no  deviation  . 

Maximum  deviation — climb  altitude  (check  one): 

±  1/16-Indi  limits . . 

±  %  inch  limits . 

±  )4-inch  limits  . . 

±  J^-inch  limits . 

Altitude  at  beginning  of  left  turn . ft 

Altitude  at  moment  wings  are  first  made  ievd  ........  ft 

Bank  deviation  (2d  15-second  interval  only— check  one): 

Failed  to  correct . 

Oscillating  over-correction  . . 

Simple  over  or  under  correction  . . 

Perfect  flying — no  deviation  occurred . 

Maximum  deviation — bank  (check  one) : 

±  2°  limits  . . 

±  4°  limits . 


±  5°  limits . 

Over  ±  6°  limits  ......... 

Climb  attitude  deviation  (3d  15-second  interval  only,  check  one): 

Failed  to  correct  . 

Oscillating  over-correction . »• 

Simple  over  or  under  correction  . . 

Perfect  flying — no  deviation  occurred . . 

Maximum  deviation-— climb  attitude  (check  one). 

±  1/16-lnch  limits . .... 

±  yi  inch  limits . . 

±  yi -inch  limits . . 

±  ;j-inch  limits  ......... 
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-  -  .«■  * %  - 

oiy  Cwn  par;. 


Pcfct 
Jfa 

Hr  sfud  dnmtiwm,  (4tk  ksK  ■ 

FnU  to  correct . ; 

Osdbtaf  •ver-carrecti**  ......... 

Scrnpit  over  or  wader  cwmctim . 

Pcfea  Syi=g— **  dnotiae  occoned 

Trimmed  fUme:  Yes . ;  No . . 

Weather  dmimf  fit ht;  * 

Saood . . 

light  tutdaa . . 

Moderate  torbakut . 

Heavy  tnrbokace . 

4.  9C°  and  180°  tarns — GC°  turn  lo  the  right;  straight  Sight  iot  30  secoHs  tie* 
12-0°  ton  to  left. 

90 *  tans 

*.  90*tura — bank  If. 

b.  Airspeed  155  m.  p.  k. 

c.  Altitude . ft  (to  be  gives). 

Besik  deviation  and  altitude  deviation  are  each  to  be  observed  during  specified  ten 
(10)  second  intervals  in  the  following  sequence: 

Fart  Secern*  7M 

10  seroods  10  seoxxb  10  seceads 


fcstrocticaa 

Completed 


CeKfAeted 


So  mexsacmeat  Suk  drrittk*  Altitude  deviatfca 
Maximum  deviations  are  to  be  recorded  for  each  characteristic  for  the  specified  inter¬ 
val  only. 

Heading  at  beginning  of  90°  turn . 
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degrees. 


i 


i 


light  tabaiem 


1.  13CP  »*1  hrf  30*. 
k  Akspeed  1SS  BLpLk. 
c_  justdt . ft.  Ito  be  pm). 

tel  iexiHiam  mad  <&Me  ietimtmm  ate  ad  to  be  atoned  dn«  «r  ifad  ffimm 
(IS)  seated  istorak  at  tbe  Mbni  aeqpWBK 


Kdmh  dematmas  axe  t»  be  recorded  fee  ™  Ae  in¬ 

terval  laijr. 

ffesdag  at  beg-Mdac  of  l*)3  tmm . - 

Hrmdixc  at  moment  nap  are  fast  made  lead . 

Ccu  deviation  (2d  lS-*coed  fatanral— cfctck  o«e): 

Fail'd  to  correct . 

Oscillating  ovex-correctjoa . . 

Simple  over  or  trader  correctio*  — ...... 

Perfect  Sying — do  deviation  occurred 
Maximum  deviation — bank  (check  o*e): 

±  2°  rrmite . 

±  4°  limits .  • 

±  6°  Emits . 

Over  ±  6°  limits . 

f.'-ii-Mt  deviation  (3d  15-second  interval— check  ooe): 

Failed  to  correct . 

Osculating  over-correction . 

Simple  over  or  trader  correction . -*  *• 

Perfect  flying — no  deviation  occurred . • 

Maximum  deviation — altitude . 
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Hmy  taWtaci  •*«••••  •• 

1  Sutt  Iw  dbrfcga teep  hank: 
a.  Bank  4S* 

k  UUtk9«41(5afiL 
4.  AMvdt . ft.  (to  be  gbtn). 

M  MW m  ud  akMade  deaaatiam  aie  each  la  be  ebenri  deiaf  specified  (a 


Hmsimmm  dmiefcnt  an  to  be  recorded  for  cadi  characteristic  for  tbe  yedfcj  in¬ 
terval  only.  X*U.—C"±i~-  :^ib«dcace  aad  confides  of  piaae  when  gratfiag. 

Am*  deviatian  (2d  10-jeomd  iatmal-cbeck  ok): 

Faded  to  correct . 

fli  ielt  aser-canedba . 

Sapk  ere  or  oader  correct!— . 

Perfect  flying  ao  dethlfaa  occaned . 

±  4°  tob . ~ 

i  «•  Ml . - 

Over  ±  «•  M> . 

Altitude  deviation  (3d  10- second  interval — check  one): 

Failed  to  comet . 

Osriflatiag  wer-cocnctloa . 

Simp**  trrex  or  under  correction . . 

Perfect  flying — do  deviation  ocean  ed . 

ifaxmwM  deviation  attitude . feet. ' 

♦ 

Detrees  to  accomplish  smooth  tarn: 

Accomplished  smooth  tom  is  less  than  120° . 

Accomplished  smooth  torn  between  120°  and  180* . 

Accomplished  smooth  tarn  in  over  180° . 

Did  not  .icconcphsh  smooth  tarn . . 

Required  by  check  pilot  to  roll  out  of  tarn  because  of  danger  . . 

Plane  condition — Satisfactory  for  steep  bank:  Yes . ;  No . 

Weather  during  steep  bank: 

Smooth .  * 

Light  turbulence . . 

Moderate  tuibuknce . 

Heavy  turbulence . 

5.  yaUs — detec-ion  and  recovery: 

a.  Glide  without  flaps. 

b.  Power  of. 


e.  Heading . °  (given  by  check  pilot). 

d.  Altitude . ft.  (given  by  check  pOot). 
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Altitude  lost  fa  recovery  from  stall  (check  oa 

*): 

0-  50  ft. . 

550-400  ft 

50-100  ft . 

400-450  ft 

100-150  ft . 

450-500  ft 

150-200  ft . 

500-550  ft 

200-250  ft . 

550-600  ft 

2S0-300  ft  . 

600-650  ft 

300-550  ft . 

650-700  ft 

Over  TOO  ft . . 

Uuxmvm  deviation  hetUn g: 

No  deriailoa . 

*  S°  limit*  .......  '  t  • 

±  S°  Bmto .  . 

Cvil  —I  S®  Bfriili  .........  " 

Smoothness  of  control  during  recovery.— Rate  the  smoothness  of  coordination  of  throttle, 
rodder,  end  stick  during  recovery  from  stall. 

Excellent .  Good . I...  Poor . . 

(19%  •/  tame)  (UtjtUj  ./  tarn*)  09% «/ 

Tendency  toward  second  slot: 

Excellent  procedure — do  loss  in  sir  speed . 

Faulty  procedure — allowed  nose  to  rise  reducing  air  speed . 

Actual  tendency  toward  second  stall — sfight  vibration . 

Weather: 

Smooth  . . 

Light  turbulence . 

Moderate  turbulence . 

Heavy  turbulence . 

1.  Recovery  from  unusual  maneuver,  a.  Full  panel. 

Check  Pilot  will  give  definite  heading,  air  speed,  and  altitude  to  pilot,  then  take  the 
controls.  He  then  will  perform  a  maneuver  that  will  place  the  plane  in  an  unusual 
position  before  returning  controls  to  the  pilot.  Proficiency  will  be  measured  in  term*  of 
the  rate  and  smoothness  with  which  the  pilot  regains  the  initial  heading,  air  speed  am. 
altitude.  Rating  can  be  given  after  pilot  baa  corrected  heading,  and  airspeed  and  has  >. 
established  climb  or  glide  that  will  regain  original  altitude. 

Heading  given  was . . .  °. 

dir  speed  given  was . m.  p.  h. 

Altitude  given  was . .  ft. 

Original  heading: 

Regained  quickly  . 

Regained  average  time . 

Regained  slowly . 

Original  latitude : 

Regained  quickly  . 

Regained  average  time . 

Regained  slowly .  • 


Original  air  speed: 

Regained  quickly . 

Regained  average  time . » 

Regained  slowly  * . 

Smoothness  in  recovery: 

Smooth  on  controls . 

Rough  on  controls . 

Jerky  on  controls  . . 

Over-controls . 


Assistance  during  recovery: 

No  assistance  given . * 

Assistance  by  words  or  signs . 

Assistance  by  movements  of  any  controls . 

Smoothness  of  control  during  recovery.  Rate  the  smoot.' ::css 
throttles,  rudder,  stick  during  recovery  from  unusual  maneuver. 

Excellent .  Good . VS ?° ' 

(it verity  *1  pHelt) 


of  coordination  of 


(10%  e!  pilott) 


311 


\J0%  *1  pitetO 


*? 

f 


Without  Cap*. 
Wheels  don. 
Bank  15*. 


SmoA 

light 

Moderate  Mubakace . 

Heavy  tuzbukaea . 

,  f9mr  MU.  To  right  for  1000  feet,  straight  flight  for  30  seconds  and  the*  0ds 
to  kft  for  100C  feet,  another  straight  glide  and  leveling  o*  at  a  specified  altitude  aa| 

d.  Air  speed  ISO  a.  p.  h. 

e.  Descent  500  ft.  per.  min. 

f.  Seatfisp  (to  be  given) . 

Chetfc  pjjgt  wQl  have  pilot  pot  plane  on  a  round  numbered  altitode,  *x*  3000,  4000, 
5000  etc,  and  will  inform  pilot  of  the  altitode  1000  feet  lower  at  which  the  gjflde  b  to 
be  completed.  At  end  of  right  glide  and  before  beginning  left  gfide,  pilot  b  to  fljr 
straight  for  about  30  seconds.  Altitude  at  end  of  each  glide  ^  taken  at  that  mome* 
the  wings  are  made  level  regardless  of  gliding  attitude  of  the  plane.  At  end  of  second 
dide  check  pilot  will  specify  altitude  and  heading  al  *».ich  pilot  is  to  level  of.  Check 
pflot’will  observe  before  start  of  glide  the  readL*  of  the  flight  indicator  which  is  indie 
alive  of  level  flight. 

Bank  demotion  and  {lade  ellitude  demotion  are  each  to  be  observed  daring  specified 
fifteen  (IS)  second  intervals  in  the  following  sequence: 

not  Sacred  Tkfcd 

Iutnrdoaa  15  jeered*  ISsecoods  IJaacredi 

Completed  TT ;  —  -rr=: - Baakdeviadaa  GBdaaittoda* 

Maximum  deviations  are  to  be  recorded  for  each  characteristic  for  the  specified  interval 
only,  ««ng  the  night  indicator.  Deviations  in  bank  are  to  be  measured  he  degrees 
from  the  original  bank  set  up  by  the  pilot.  Deviations  in  glide  attitude  are  to  be 
measured  in  terms  of  the  linear  distance  that  the  horizon  line  fluctuates  from  the 
original  position  set  up  by  the  pilot. 

Right  torn 

Altitude  at  beginning  of  right  torn . ft* 

Altitude  at  moment  wings  are  first  made  level . ft 

Bank  deviation  (2d  15 -second  interval  only,  Maximum  deviation — bank  (check  ooe): 


check  one): 

Failed  to  correct 
Oscillating  over -correction 


±  2°  Emits 
±  4°  Emits 


Simple  over  orunder  correction . .  ±6°  limits 


Over  ±.  6°  limits . 

Maximum  deviation — glide  attitude  (check 
one): 


±  ^-inch  Emits 
±  54-inch  limits 
±  54-inch  Emits 
±  54-inch  Emits 


Perfect  flying — no  deviation 
Glide  attitude  deviation  (3d  15-second  in 
terval  only) : 

Failed  to  correct . 

Oscillating  over-correction . 

Simple  over  or  under  correction . 

Perfect  flying— no  deviation . 

Left  turn 

Attitude  at  beginning  of  left  turn . feet. 

Altitude  at  moment  wings  are  first  made  levd . feet. 

Be  ?!>  deviation  (2d  IS -second  interval  only,  Maximum  deviation — bank  (check  one): 
check  one) : 

Failed  to  correct .  ±2°  Emits . 

Oscillating  over-correction .  ±4°  Emits . 

Simple  over  or  under  correction  . .  ±6°  limits . 

Perfect  flying — no  deviation .  Over  ±  6°  limits . . 
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GS ie  oUMode  deoiati—  (34  IS  >m<  to-  Uarimom  dniati—  f»r  ottdadc  (ctafc 
terra!  Mir.  dfcdk  Mt):  oac): 

Failed  to  cancel .  ±  1/It-fafc  I alts . 

OsaBatlt  tm-MimtiM . .  ±  Jfhd  late . ~ 

SaMfdeovcroroaderconcctfao .  ±  J(-iKk  Barite . 

perfect  fyhf-oo  devfad— .  ±  Ji4d  Ub . — 

Srafefcfffr 

Spedfud  heading  tor  fcvefag  of . *. 

Aerimt  heading  at  «Uck  leveled  of . *. 

Sfoofied  altitmde  for  levdtot  of . fad. 

detaof  altitude  at  vUd  leveled  of . .  fact. 

Trimmed  ft toe  (for  whole  manner):  Ye* . ;  Ho . 

Weather  dmriag  fide: 

Saaoodi . 

Light  taibdeaw  ......... 

Moderate  Uabaieace . 

Heavy  turfcaieace  ....... •. 


7W330— 47— It 
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AIPINDH  I _ — - - 

Airplane  Commander 
Rating  Scales 


(M»> 

.  Numbers  of  weeks  experience  with  Mi 

UMjpo^mwO  group  of  Hudeat*  . 

Instmdions  I#  refers 

Yon  ue  brie*  asked  tm  sate  each  of  several  Airplane  Comma  ode  r»  of  crews  k*  tnia- 
b*  at  tow  station.  For  each  of  the  itesu  on  this  ratine  scale,  yon  should  rad  /the 
question  at  the  top  and  each  of  the  five  statements  nudes  it,  lhcn  for  each  stndeat, 
decide  which  oae  of  the  five  statements  ia  year  ofirdon  best  describes  Mat  stndeat  uf 
bis  abilities  and  probable  reactions  Them,  beside  the  naaae  of  that  stndeat,  put  on  *V 
ia  the  box  baring  the  same  coboaa  Bomber  as  the  statement  yon  have  selected.  It  is 
doubtful  that  any  statement  w3l  describe  a  student  exactly,  bat  yon  an  being  asked 
to  we  yow  judgment  h  dtekfing  which  oae  of  the  five  statements  most  nearly  fits  each 
student.  Avoid  using  the  opinion  of  others;  this  rating  should  be  y cur  opinion  of  the 
Airplane  Commanders  fined. 

Item  A. .  How  strongly  wotdd  this  mrftane  commander  be  recommended  for  a  fanbk 
lead  crew  assignment? 

t.  This  airplane  commander  has  done  an  out¬ 
standing  job  and  definitely  would  be  ream- 
mended  as  a  lead  airplane  commander. 

2  This  airplane  commander  has  done  wd  aad 
would  be  strongly  considered  as  lead  crew 
material. 

3.  This  airplane  commander  has  done  what  was 
expected  of  him  and  might  be  recommended 
for  a  lead  crew  position  provided  he  works 
harder. 

4.  This  airplane  commander  probably  would  no* 
be  recommended  for  a  lead  assignment  al¬ 
though  be  has  completed  the  requirements. 

'  S.  This  airplane  commander  has  scarcely  coo* 
oleted  the  minimum  essentials  and  would  W* 
.>e  considered  as  lead  calibre. 


S 


1 


2 


3 


4 


ItrnB.  Sow  w*M  has  this  airfiane  command*,  mastered  formation  pyingt 


*•  *kpl«a*  commander  fits  very  wdl  fa  «| 
formation  position  sad  operates  smooth^ 
vitk  excellent  judgment  fa  anticipating  actions 
of  ttWtt  . 


2.  This  airplane  commander  a  good  fa  (ohm* 
tioa  Hying,  observes  sta adfag  operating  proce¬ 
dure*  sad  easily  maintains  Us  podia. 


2.  This  sirplsae  commander  understands  fans 
tioa  flying  and  is  is  Jr  fa  assembly  aad  break* 
op  of  formation. 


4.  This  airplane  commander  Us  proper 

position  with  some  difficulty  aad  is  a  Ittlt 
rough  in  formation  penetration  aad  reasaeas- 
Uy. 


S.  This  airplane  commander  sometimes  fafls  to 
foDow  standing  operating  procedures  and  oc- 
casionaOy  aegJecU  to  warn  other  crews  of 

Afliyi 


Item  C.  Soto  eager  and  interested  is  this  airplane  commander  m  hi e  job  and  training 
acthMest 


1. '  This  airplane  commander  is  an  eager  beaver, 

works  bard  at  extra  tasks,  learns  new  tech¬ 
niques,  and  completes  training  ahead  of  others. 

2.  This  airplane  commander  likes  his  job  and 
shows  more  than  avenge  interest  by  putting 
in  extra  hours  on  trainers,  missions,  and  by 
going  to  classes  of  other  crew  members. 

3.  This  airplane  commander  does  aH  that  is  ex¬ 
pected  of  him  and  shows  average  interest  in 
the  progress  of  his  crew. 

4.  This  airplane  commander  seems  to  display  a 
lack  of  interest  but  usually  can  be  relied  upon 
to  complete  the  minimum  essentials  of  training. 

5.  This  airplane  commander  seems  to  be  dis¬ 
interested  in  his  job,  slovenly  in  accomplish¬ 
ing  his  training,  and  unconcerned  about  im¬ 
proving  himself. 
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Utm  D.  Bern  «d  does  this  deplane  commander  prepare,  pUn  ahead,  mi  mmAm, 
tht  acthkks  »/  Ms  emit 


1.  This  airplane  commander  ahraya  plans  ahead, 
uses  excellent  judgment,  and  never  leaves  aay. 
thing  to  chance  (or  which  be  can  prepaid 

2.  This  airplane  commander  usually  plana  <he 
activities  of  his  crew  in  some  detail,  uses  good 
judgment,  and  seldom  b  hurried  in  makfaw 

tWltUiw 

3.  This  airplane  commander  plans  and  prepares 
adequately,  uses  fair  judgment,  but  sometimes 
b  hesitant  about  effecting  appropriate 

4.  Thu  airplane  commander  plans  the  Wight  ac¬ 
tivities  of  his  crew  fairly  well  but  sometimes 
neglects  important  factors  and  has  some  Hist- 
culty  in  making  necessary  decisions. 

5.  Thu  airplane  commander  seldom  prepares 
sufficiently  well,  seems  to  become  confused 
under  pressure,  and  makes  mistakes. 


Item  B.  How  adequate  is  this  airplane  commander's  ability  to  lead  and  svpcrviset 


1.  Thu  airplane  commander  obtains  the  maxi¬ 
mum  from  his  own  team  and  has  the  respect 
of  other  crews.  He  is  exceptional. 


2.  This  airplane  commander  b  conscientious, 
understanding,  and  reasonably  skillful  as  a 
leader. 

3.  This  airplane  commander  accepts  his  respon¬ 
sibilities  and  shows  average  effort  in  leading 
the  activities  of  his  crew. 

4.  This  airplane  commander  knows  what  is  ex¬ 
pected  of  him  but  fails  to  obtain  the  confi¬ 
dence  of  his  crew. 

5.  This  airplane  commander  lacks  understand¬ 
ing  of  his  responsibilities  and  thinks  his  job 
is  done  when  he  lands  the  aircraft. 


•  A 
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jum  t.  Bow  sktBftd  is  tUs  B-29  airplane  commander  tm  instrument  ffyingt 


• 

2.  TUs  airplane  commander  Is  sore  skffifui  than 
the  average  la  flying  by  itutnaaeoi*  and  sel¬ 
dom  becomes  fatigued. 

* 

3.  This  airplaoe  commander  demonstrates  sw¬ 
age  proficiency  la  instrument  firing  and  tire* 
no  more  than  may  be  expected. 

4.  This  airplane  commander  seems  to  be  weak 
Is  radio  orientation  and  Instrument  let-down 
procedures  and  sometimes  misinterprets  Us 
instruments. 

S.  This  airplane  commander  Is  somewhat  de¬ 
ficient  in  instrument  flying  techniques  and 
seems  to  lack  adequate  understanding  of  air¬ 
craft  instruments. 

1 

2 

3 

4 

S 

• 

c 

Item  G.  Son  would  you  rank  '.his  airplane  commander  m  over-att  efficiency  mud  abdity 
among  oO  iSe  airplane  commanders  now  in  training  at  your  statkmt 


• 

1.  In  the  highest  10  percent— on;  of  the  very 
best. 

1 

2.  In  the  upper  20  percent — very  good. 

2 

3.  In  the  middle  40  percent— competent  and  able. 

3 

4.  In  the  lower  20  perernt— fairly  proficient 

4 

S.  In  the  lowest  10  percent— minimum  satisfac¬ 
tory. 

3 

1 

1 

i 

* 

1 

I 

! 


Appendix  F.2 

Ratino  of  Airplay*  Commands** 
Scale  A 

(Name  «/  rater) 


(DeU) 


(PttUten) 
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i 

ii 

;>  . 

j  Mndknt  to  rtton 

■  Yo#  an  being  asked  to  raU  e*ch  of  several  airplane  commanders  on  crews  is  t nh- 

inc  at  your  station.  For  each  of  tbe  Items  oa  this  rating  scale  you  should  read  tin  q^a. 
Um  at  lb*  top  and  each  oi  the  five  statements  under  it.  Then  for  each  student,  <fed4s 
whid  o»5  of  tbe  fivr  lUttmtaU  is  yvw  opinion  best  describes  that  student  or  Ids 
abilities  aad  probable  reaction*  Then  place  a  check  mark  in  the  box  bavin*  tbe  tune 
churns  number  as  tbe  number  of  the  statement  which  best  describes  each  one  and  which 
is  immediately  opposite  the  appropriate  crew  number.  It  is  doubtful  that  any  statement 
will  exactly  describe  a  student,  hot  you  are  being  asked  to  use  your  judgment  In  deddJaj 
which  one  of  the  five  statements  most  marly  fits  each  student  Avoid  using  the  opinio* 
of  others;  this  rating  should  be  your  opinion  of  the  airplane  commanders  listed. 

Some  airplane  commanders  appear  to  be  able  to  anticipate  impending  events  mote 
rapidly  than  others.  This  may  be  called  foresight.  For  example,  anticipation  of  tuna, 
la  altitude,  gayflfa*  consumption,  necessary  equipment,  flak,  IP^  weather,  etc. 

*  How  much  foresight  does  this  airphine  commander  demonstrate? 


1.  This  airplane  commander  has  the  unique 
ability  to  foresee  almost  every  fanpemfing  oc¬ 
currence  and  their  complete  implications.  Ha 
invariably  evades  their  undesirable  effects  by 
appropriate  action. 

2.  This  airplane  commander  is  always  alert  to 
the  possibilities  of  impending  occurrences  and 
their  probable  implications.  He  minimizes  their 
effect  by  wise  preventive  and  corrective  ac¬ 
tion. 

3.  This  airplane  commander  is  generally  alert  to 
the  possibilities  of  impending  occurrences  and  • 
their  probable  implications.  He  is  generally 
adept  in  initiating  the  proper  preventive  and' 
corrective  action.  - 

4.  This  airplane  commander  sometimes  sees  the 
possibility  of  some  situations  occurring.  He 
may  fail  to  see  all  the  implications  involved 
and  occasionally  has  difficulty  in  choosing  the 
proper  corrective  action. 

5.  This  airplane  commander  frequently  fans  to 
see  the  possibility  of  situations  occurring.  He 
ofUn  fails  to  see  all  implications  involved  and 
is  sometimes  confused  with  regard  t?i  the 
proper  preventive  procedure. 


Crew 

Number 

Name 

ASN 

5 

4 

3 

2 

1 

1 

I 

1 

t 

1 

_ _ 
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t 


Bow  much  Interest  does  this  airplane  commander  taka  in  kb  crew? 


1.  This  airplane  commander  b  enthusiastically  in* 
tr rested  In  ail  phases  of  the  crew  activities 
both  personal  and  technical  He  fc  constantly 
alert  to  assist  them  in  any  reasonable  manner 
even  if  it  results  in  embarrassment  for 


2.  Thu  airplane  commander  b  interested  in  at 
phases  of  crew  activity  both  personal  and 
technical.  He  b  usually  alert  to  assist  them 
in  any  reasonable  manner  even  if  it  results  in 
added  effort  on  hb  part. 

3.  This  airplane  commander  b  usually  tntyrr«tfd 
in  all  phase*  of  crew  activity.  He  will  always 
help  them  with  their  personal  and  «erfmle»l 
problems. 

4.  This  airplane  commander  rarely  evidences  in¬ 
terest  in  the  activities  of  the  crew.  However, 
when  crew  members  present  their  personal  or 
technical  problems  to  him  he  usually  helps 
solve  them. 

5.  Thu  airplane  commander  b  obviously  disin¬ 
terested  in  hb  crew.  He  apparently  b  not 
interested  in  their  personal  problems  and  b 
unconcerned  with  their  technical  improve¬ 
ment 

l 


Crew 

Number 

Name 

ASN 

S 

4 

« 

! 

APflRIKt 


Check  List  of 

Airplane  Commander  Ability 


Appcn£x  G-l 

Onrt  Lor  or  Aarnn  Oboujmi  Aaaczrr 

CvFO&MATKXt: 

Xott  .  Kni  . .  ASM  . 

Type  of  aircraft  . .  Hosts  Os  aircraft  . 

INFORMATION  ON  CHECK  PILOT: 

Name  .  Rtdk  .  ASM  . 

B*e  .  Field  . 

Goedorsbt  Armji  or  Poor  or  wist 
top  10%  ci  whatarerape  lowest  10%  Faded 
pSots  pilots  gfpiob  towh 

wtwld  ft  would  do  sndd  do  check 

Before  take-of  checks 


1.  Visual  outside  check 

(manner  hi  which 
check  is  conducted) . 

2.  Visual  interior  check 
(manner  in  which 
check  is  conducted)..  ... 

3.  Check  on  crew  mem¬ 

bers  pceffighting  of 
positions  . 

4.  Personal  equipment 

inspection  . 

5.  Briefing  of  crew . 

6.  Instruction  to  crew 

(if  necessary) . 

7.  Cockpit  procedure  and 

check  . 

8.  Pilot’s  manner  of  mak¬ 

ing  all  checks  (e.g., 
systematic,  business¬ 
like)  . 

9.  Taxi  procedure . 

10.  Check  if  crew  is  in 
take-off  position: 

Yes . ;  No 
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G*«d  or  vta  Antnjt  «r  fW«r«te 
**P  >0%  «r  rttimocc  toffee  10% 
pfao  parts  rtplrts 

•mU  <to  snU4 

U.  frtrtphm  iwotoc  . 

|  12-  O'VrSnesi  rt  ytoc  . 

11-  Crew  cwpadw . 

14.  CaSs  acw  tor 

Tes . ;  N» . . 


Afijr  tmdmt:  T„  Mm 

L  Makes  after  mdmg  «tol| . .  . ’ 

1  Fa*  art  reqwited  ions .  . 

1  Cheeks  aew  members,  critiques  arisao* . 

4.  Checks  macs,  pres  mstndim . 

1  Checks  poEce  of  plane  and  camp . . 

Be  marks: 

Cement: 

Goodorsbt  Average  or  Poor  or  what 
top  IS  per-  what  average  lowest  10  per  Failed  to 
cent  of  pilots  pilots  would  cert  of  (dob  make 
would  do  do  sndd  do  check 

1.  Gveral  ratine  as  an 

airp’aae  commander. .  . . . 

2.  General  pilot  xbtEty. .  ..." . 

3.  General  pilot-crew  re¬ 
lations  . .  . 

3t3iza*ip» *ahraitjcg  . 

taae” .  . 

5.  Ground  discipline . . 

f.  Air  disdpfine . . 

1-  Called  officers  by  cor- 

*  rect  titles 

Yes . ;  No . 

8.  Called  enlisted  men 
by  correct  titles 

-  Yes . ;  No . 

Remarks: 


:'3 


AMRBIX 1 - - 

AAF  Letter  50-117. 
Subject:  Screening  of  Combat 
Crew  Personnel 

Afffiti  BL1 

50-m 

Ihn 

rm  i 

RiWMina,  Am  As  Peaces, 
Watimpm,  7  Jmme  MS. 

AAF  Letter  50411. 

Scwjacr:  Screcaoag  af  Cm tel  Oo  Ptsed. 

Director,  Aar  Takeol  Sen**  Cwmai 

Ca— mfieg  GtmA  aed  Cwuffiii  Ottcm,  ladrpewdeet  AAF  AdmBe. 

"ra  f  [  Geeenk  a*i  Cisurlag  Otters,  Sabcrtfiute  AAF 
Coaasaeda  sad  AAF  Dmaas  Wap  tad  Dbtridx 
Coaaaaawfiac  Ottcm,  AAF  Base  Cats  (sot  iebdrd  above). 

(This  Letter  apendo  AAF  Letter  50-117, 1  May  1945.) 

L  Oae  ml  tbe  majof  .r  utes  la  the  theaters  is  tbe  wlrrting  aad  hihw|  of  qaiHd 
lead  um  At  pmnt  tbe  tedc  a.  forming  lead  crews  has  bee*  placed  os  tbe  tacti¬ 
cal  rtpaiatiaet  is  tbe  field  after  tbe  arms  save  completed  their  training  is  the  Zaae 
of  tbe  latcxior.  la  tbe  proo  •»  of  forming  lead  crews  is  the  tactical  ocyamratinas  «  it 
qwite  ofta  necessary  to  break  ep  two  oc  three  crews,  thus  voiding  much  of  the  crew 
tnoh(  aad  breaking  up  tbe  integrity  of  the  combat  crew.  It  is  believed  that  the  , 
fcfiowiag  procedures  wil  facState  tbe  identification  and  t-aining  of  lead  crews  ad 
reduce  tbe  member  of  necessary  changes  in  crew  personnel. 

2.  Tbe  assignment  of  personnel  to  crews  and  the  designation  of  certain  crews  a 
potential  lead  crews  win  be  made  at  the  AAF  Combat  Crew  Processing  and  Distribu¬ 
tion  Center  in  the  AAF  Training  Command  os  the  basis  of  a  lead  crew  aptitude  score 
given  to  cadi  officer  aircrew  member.  This  lead  crew  aptitude  score  will  be  a  weighted 
average  of  evaluations  of  aerial  training  and  experience,  written  proficiency  examina¬ 
tions  in  appropriate  specialties,  md  original  aircrew  aptitude  test  scores, 

3.  The  lead  crew  aptitude  score  for  each  crew  member  will  be  entered  on  bis  AAF 
Individual  Training  Record  Form  as  provided  for  in  AAF  Letter  59-55.  If  be  is  assigned 

to  a  potential  lead  crew  tbe  letter  “L”  will  be  entered  after  tie  lead  crew  aptitude  j 
score.  If  during  subsequent  training  be  b  removed  from  a  potential  lead  crew  for.  lack 
of  profiricucy,  suitable  notation  will  be  made  in  the  “Remarks”  section. 

4.  Potential  lead  crews  will  be  composed  of  aircrew  members  who  have  the  highest 
lead  crew  aptitude  scores,  namely,  seven,  eight,  and  nine.  Insofar  as  possible,  potential 
lead  crew*  wOl  be  made  up  of  crew  members  all  of  whom  have  lead  crew  aptitude  scons 

of  nine,  all  of  whom  have  lead  crew  aptitude  scores  of  eight,  or  all  of  whom  have  lead  i 
crew  aptitude  scores  of  seven.  The  remaining  combat  crew*  will  be  assembled  without  j 

regard  to  lead  crew  aptitude  score*.  ' 

* 
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s.  A  Coo*et  Got  Record  Form  (copy  attached)  w*  be  kRtialed  at  the  AAF  Gn»> 
W  C*ot  hwaAf  iW  Dotribrstre*  Ceafer,  which  wfl  facilitate  whether  the  at* 
is  doiprtrf  »  •  kadi  crew  «c  as  a  aebrt  acw.  Ik  ant,  task,  tad  atrial 

aaakt  of  od  ctcw  ncnbu  wiptd  to  the  acw  aril  he  catered.  This  Una  sfl  ha 
let  warded  la  dopicifi  to  the  canhat  ctcw  trifakg  alalia*  to  which  the  acw  k  ant. 
Authority  is  treated  to  the  AAF  Tanateg  Ceoaauad  far  the  repredoaia*  ad  this  fana 
as  show*  a  the  a*1arhaarat  to  this  Letter,  ia  saKoeat  to  finish  a  dm  (J) 

■r-* - TT*r  f* - t  the  ‘  *r  fm^at  rrnr  r  iri  I*X  »al  Cewter. 

A  Vpom  mplrtiow  ol  combat  acw  tniahi..  the  «f  poteadal  had  acW 

or  of  canhat  acw  aside  as  the  AAF  Tniaaf  Caaaaaaad  «X  be  raaimcl  or  rrrhad  ' 
at  the  treiaric  air  farce  statiaa  sad  aakahle  potation  wA  be  node  oa  the  fan. 
Appropriate  marks  cowcoang  the  prahoeacy  of  the  crew  as  a  whale  si  he  cakwt 
7.  Ike  origin!  af  the  Ccaabat  Got  Record  Fore,  al  be  fia  ■  anted  to  the  tbeaicr 
far  the  iafomatiea  af  the  combat  arpaitUMo  to  which  the  crew  is  ~  ajprd  The 
dcpfcalr  aril  be  forwarded  to  the  rowiiraiaifr-g  general  of  the  air  farce  la  which  cam- 
hat  acw  trifaif  k  oaconpfchedL  The  sarpsa  aad  the  oftc e  »wp<«*i.  far  txafain 
ptocnaas  at  the  headquarters  tf  hear  force  wil  cse  this  iafomatioa  to  rrabnk  the 


A.  If,  at  aay  tine  sobacqoeat  to  ccigim]  .  iwaUj  of  the  acw,  it  nay  become 
smiy  to  sohslitate  for  aay  acw  aster,  rmy  eSort  aril  be  aaade  to  replace  Mra 
with  aa  aircrew  aster  bant  the  sane  lead  acw  aptrtode  scaoe. 

9.  A  dearaace  aarraber  is  set  reported  for  the  Cdoiat  Crew  Record  Font  wader 
pegriaows  of  paragraph  4a  (2),  AAF  Irpmta«  0-2. 

Rr  CtaauMB  or  Gan  Aawanc 

(aa)  fas  C.  Kean. 

Lieuteuuut  Cement,  VmUd  SUUs  Army, 
Deputy  Ccmmmmitr,  Army  Air  F urea. 
Altidmot:  Sample  Combat  Crew  Record  Fern. 

Dbtributioo:  Air  forces  and  AAF  conanirrii  mm 


Covur  Grew  Rrcoo  Foex 
AAF  Tsuujooc  Cosocaks  • 


Xz 


AiipiiK  ao~nJg  (Law  ■«■>  fcW) 

I. 

Dale 

Tjj*  at 
aircraft 

i  JZtm 

\ 

Cnm 

I.  Potealial  lead  new  j 

Castor  ocar 

□ 

Crew  Roster 


Last  Base  First  Bine  MI  Grade  ASM 

Law  aaaa  First  aaaa 

MI  Grade  ASM 

Co-FOcC 

J. 

Gmaer 

XoipW 

4. 

Garaar 

♦ 

Beobardiar 

J. 

Cesser 

Flight  eapMcr 
i 

Gsascr 

Radar  observer 

7, 

Gnaacr 

G saner 

*. 

Reaurka 

». 

Authenticated  by: 
Station: 
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Air  r mu  (Training) 


U. 


Astkeatkated  fcjr: 


[«tinn«i«  fot  Caamxxmr  or  CoMMJf  Caxw  Ricjw  Fane 
The  Cm  Record  Form  is  i*  accordance  witk  AAF  Letter  Jfr-IH, 

to  provide  a  cantsuous  evaluative  record  of  tbe  bombardment  at*  from  tie  tine  it  ii 
«Bdl  It  CCTS  Section  I  is  to  be  coc  -Vied  in  tbe  hit 

Tnini  Command  and  Section  II  In  tbe  training  air  force.  Specif  .  directions  for  cans-  . 

-  *  «*  ^  - nn  

frrfirn  1,  AAF  Trmmmg  Ctmmrmi  Tbe  form  aril  be  initiated  In  dupBcnte  at 
tbe  AAF  Cbcabat  Crew  riori  Mint  *nd  Dbtnbotioo  Crater  and  both  copies  ni  be 
mailed  dbectly  to  tbe  iuHnminrting  oSbcer  of  tbe  combat  crew  training  station  t» 
vhkh  tbe  crew  ii  scat, 
lane  I 

a.  Name,  grade,  and  ASN  of  airplane  commander  at  tbe  time  of  crew  tap- 
mot.  If  tbe  airplane  commander  is  subsequently  replaced,  n  Sue  wS  be 
drawn  tbioogb  this  catty  and  tbe  new  airplane  commander's  name  wi  be 
entered  in  tic  appropriate  space  below. 

b.  Type  of  aircraft  for  Tbidt  tbe  crew  is  tyenbhd  j 

c.  Code  number  or  current  symbol  for  designation  of  tbe  crew.  j 

a.  Name  of  the  CCTS  to  which  tbe  crew  is  sent  for  training.  *  I 

Um*  2  1 

On  the  basis  of  procedures  outlined  in  paragraph  2  of  tbe  stAF  Letter  cited  j 
above  and  specific  directives  irom  tbe  Commanding  General,  AAF  Training  Coni'  j 

mind,  tbe  crew  win  be  evaluated  as  potential  lead  crew  or  combel  crew  and  tn 
“X”  will  be  placed  in  the  appropriate  box.  i 

Un e  3  ihrrutk  I 

Using  only  spaces  which  are  app&cable  for  the  type  of  aircraft  to  which  tie 
crew  is  assigned,  names,  grades,  and  ASN's  of  crew  members  will  be  entered,  j 
When  crew  changes  are  made  a  line  will  be  drawn  through  the  name  of  each 
member  replaced  and  new  members  win  be  listed  as  speribed  below. 

Lou  9 

Remarks  on  any  additional  pertinent  information  regarding  the  assembly  of  a 
particular  crew.  Tbe  officer  in  charge  of  crew  assembly  will  authenticate  tH* 
section. 

Section  11,  Training  Air  Foret.  Two  copies  of  the  form  wfll  be  completed. 

The  original  will  be  placed  in  a  sealed  envelope  and  entrusted  to  the  tiijAu* 
commander  for  delivery  to  the  commanding  officer  of  the  combat  group  to  which 
the  crew  is  assigned  ;r  the  theater  of  operations.  The  duplicate  will  be  for* 
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■aided  to  the  Cnmmaaifat  Geaetal  of  ike  air  tore  ia  *Udk  OCXS  tntotof, 
attcatios  mjm,  b  acrompKdcd. 

£mr  »  _ 

a.  Km  of  OCXS. 

k.  fe  aiid  Ike  tmr  completes  tnbip. 

c  Dale  of  completion  of  Seal—  IL 

i  Average  areola. r  error  of  tke  error  made  »  ccoagdetiap  tke  aUam  ttqdRaot 
for  bombs  dropped  as  ootEbed  ia  tke  AAF  Tnatof  Staadanfa  JM,  JM, 
or  XKJ. 
fm  11 

Oa  tbe  bass  of  pnfotmaac *  ia  CCIS  Ike  ett  il  be  departed  os  a  pda- 
tial  bad  creor  or  a  combat  atr  xad  aa  “X”  plead  ia  tke  appropriate  boa. 
1m  12  Onsfi  IS 

Cirm  ekaapes  arid  be  recorded  by  ixSatin  tke  crew  paadw  of  tko  arw 
(tiiphae  co— aader,  uriptcr,  etc.),  same  trade  aad  ASM  of  Ike  arw 
member,  aad  tke  msoa  for  remoral  of  tke  odpad  member  (medial,  ferioagfc, 
bek  of  profcrieacy,  etc), 
fm  Id 

Addtkmal  enhutkm  of  tie  crew  orffl  be  catered  trader  “Remarks*  Tkb  soe- 
tba  will  be  aotbeaticated  by  tke  odicer  ia  ckarge  of  tufa dtp. 


APPENDIX  1 


Experience  and  Opinions 
Questionnaire 


Appeb&  LI 

Omen  Qratnocuns  , 

% 

(Baaed  on  52S  cases  uak»  otherwise  indented) 

Tkit  qnritio— siit  k  to  detenun  aad  record  jroar  experiences  rod  opinions  ts 
an  (dicer  returned  (no  cmbaL  Array  Air  Forces  are  vitafiy  interested  ia  finding 
oat  your  readies  to  your  trenting,  to  what  you  have  doue  aad  aeca  vUt  ia 
combat  aad  to  your  present  aspaeaL  Tins  questionnaire  is  not  to  be  considered 
a  test  of  any  kind  but  rather  as  a  record  of  what  you  have  seta,  what  you  hm 
doue  aad  what  you  think. 

You  ml  find  that  the  questions  may  be  answered  by  indicating  the  number  of  me 
of  the  alternative  am  vers  in  the  space  provided  oa  the  answer  sheet.  Be  sure  that  you 
write  the  number  ic-fiating  you*-  answer  in  the  space  corresponding  to  the  question. 
However,  in  some  of  the  questions  you  will  find  that  the  alternatives  listed  do  set 
include  your  answer.  Instructions  are  given  with  these  questions  to  write  your  answer 
in  the  space  provided  cm  the  beck  of  your  answer  sheet  Read  the  question  and  al  of  the 
alternative  answers  before  answering  the  question.  Do  not  skip  any  question.  Answer 
each  one  to  the  bed  of  your  ability. 

This  booklet  of  questions  will  be  used  again  for  another  returned  officer,  therefore, 
you  are  requested  not  to  make  any  pencil  marks  upon  it  or  deface  it  in  any  way. 
Write  your  name,  serial  number,  present  post  or  field  and  date  on  the  answer  sb«t 
in  the  space  provided.  Record  the  principal  MOS  held  in  combat  and  all  ether  MOS’s  ia 
which  you  are  qualified  on  the  lines  provided.  Your  name  is  desired  in  order  tht> 
further  information  about  you  may  be  obtained  from  your  Form  66-2.  Your  name 
will  net  accompany  any  report  of  the  findings  of  this  study.  Do  not  hesitate  to  choose 
the  answers  that  express  the  way  you  really  feel  and  think  There  will  be  no  time 
Omit.  * 

The  first  question  asks,  “What  is  your  present  grade?”  Under  the  question  Is  a  hit 
of  grades  from  Colonel  to  Flight  Officer.  Pick  out  your  present  grade  and  write  the 
number  corresponding  tc  it  on  the  list  of  alternative  answers  in  the  space  under  “1" 
on  your  answer  sheet.  Continue  in  the  same  manner  for  the  remainder  of  the  questions. 

/ 

omen  QursnojrxAiai 


>•** 

Percent 

A*e 

P  «**» 

i!  «  k . 

.  1.9 

26 .  . . .  „ . 

. 17.1 

n . 

.  3.4 

27  ... 

. 114 

is . 

.  lt.S 

2ft 

. 94 

14  . 

.  i7.2 

2$  . . . 

.  ...  *4' 

IS  . 

30  or  more  . 

.  44 
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(Percentage  dbtributJow  of  answers  b  fadkatcd  is  tqb) 

(1)  What  b  you  present  grade?  (Writ*  the  correct  Male  fa  v«ct  No.  1) 

OjO  1  Cotoad. 

2  2  Iiwtttut  Cifai 

5.7  J  Major. 

34 J  4  Captain. 

52  S  S  First  LindtanL 

4.7  6  Secoad  Lieutenant 
2  A  7  Flight  Officer. 

*  Other  (indicate  what  oo  back  of  answer  sheet  to  No.  1). 

(2)  What  b  your  age  in  yean,  to  your  Dearest  birthday?  (Write  it  fa  *»ca  No.  2) 

(3}  Are  you  married  or  singk?  (Write  only  one  number  fa  gaa  No.  3) 

-HU  1  slack. 

S3  2  widowed.  ' 

.9  3  divorced  or  separated  other  than  by  mflkary  wttwity 

33.9  4  married,  before  going  overseas. 

.9  5  married,  zUe  overseas. 

26.X  6  married,  sxa  returning  from  n*»e— «» 

(4)  How  many  dependents  do  you  bare?  (Indude  wife,  dependent  parents  or 

children) 

400  1  one.  ,  - 

20.9  2  two. 

13  3.  three. 

Jb  4  four. 

.6  5  five  or  more. 

360  6  none. 

i 

'  y 

(5)  Before  entering  the  army  how  far  did  you  go  in  school? 

27.7  1  high  school  and/or  vocational  school  graduate  or  leas.  ; 

100  2  one  year  college. 

26.3  3  two  yean  college. 

16.1  4  three  yean  college.  j. 

140  S  four  yean  college  or  graduated  from-  college. 

2.8  6  did  post  graduate  work  in  college  or  university. 

2.5  7  attended  or  graduated  from  professional  school  (dental,  medical, 

engineering,  etc.). 

.4  8  attended  United  States  Military  Academy  but  did  not  graduate. 

2  9  United  States  Military  Academy  graduate. 

(6)  What  was  your  principal  duty  or  aeronautical  rating  during  MOST  of  the  time 

you  were  in  combat  tLeaters?  (Write  only  one  number  in  space  No.  6.) 

54.9  1  Pilot. 

4.4  2  Copilot 
14.6  3  Bombardier. 

19.1  4  Navigator. 

5.9  5  Bombardier-Navigator. 

.4  6  Aircraft  Observer. 

X)  7  Officer:  Flight  Engineer. 

.0  8  Officer:  Radar  Observer. 

.8  9  Other  (write  what  on  the  back  of  the  answer  shi  t  after  No.  6). 
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(?)  DM  ym  fly  a  lead  positfeft  to  a  flight,  or  (roup  formatloa  for  at  lea* 

J|N  «u«i>  II  yoe  Md  boU  a  squadron  and  a  stoop  positioa  record  ody 
Um  snap  positioa.  If  yoo  bdd  a  squadron  or  snap  podtioo  not  fatdoded  in 
tkt  ijt  bdow,  writ*  in  alternative  10  and  write  the  aaae  of  the  poskiow  an 
the  back  of  the  answer  sheet  next  to  No.  7.  (Write  only  oae  number  in 
No.  74 

U  1  Lead  pflot,  group 

14.7  2  Lead  pflet,  aqnadw. 

182  J  Lead  pOot,  flight. 

S.J  4  Lead  boobardkr,  snap, 
ti  S  Lead  bombardier,  squadron. 

3.8  t  Lead  bombanfler,  flfeht. 

S3  7  Lead  navigator,  snap. 

IS  t  Lead  navigator,  squadron. 

It  9  Lead  aavfgator,  flight. 

2JJ  to  other  (Write  what  oa  back  of  answer  sheet  aiur  No.  7)  or  did  aot 
bold  grorp,  squadron  or  flicbt  positioa. 


Various  cf  opinion  co Deeming  the  motivation  of  men  in  combat  have  beta 

given.  It  is  known  that  the  motivating  factors  are  different  during  the  initial 
than  during  the  remainder  of  the  tour  of  combat  Indicate  the  degree  to  which  each  of 
the  following  factors  motivated  you  during  the  second  half  of  your  stay  in  the  combat 


(8)  Thought  it  was  the  best  way  to  strike  an  active  blow  against  the  enemy. 

403  1  influenced  me  greatly. 

48.7  2  influenced  me  somewhat 
1010  3  rfid  not  influence  me. 

. 

(9)  Desired  to  do  a  good  job  and  contribute  my  share. 

78.4  1  influenced  me  greatly. 

19i  2  influenced  me  somewhat  - 

.9  3  did  not  influence  me. 

(10)  Didn’t  want  to  let  tie  other  members  of  the  crew  down  by  quitting. 

49.1  1  influenced  me  greatly. 

25.4  2  influenced  me  somewhat 

242  3  rfid  not  influence  me. 

(11)  Liked  the  excitement  of  combat  , 

18.0  1  influenced  me  greatly. 

422  2  influenced  me  somewhat 

381  3  did  not  influence  me. 

(12)  Preferred  flying  duty  to  ground  duty. 

712  1  influenced  me  greatly. 

19.7  2  influenced  me  somewhat 

83  3  did  not  influence  me. 

(13)  Performed  the  duties  only  because  I  was  ordered  to  do  so, 

3.4  1  influenced  me  greatly. 

18j0  2  influenced  me  somewhat 

77.1  3  did  not  influence  me. 

Judging  from  your  experience  in  combat  from  what  age  periods  do  the  most  successful 
combat  officers  come?  Make  your  judgment  on  the  basis  of  the  performance  of  the 
officer  in  combat.  There  are  four  questions  to  be  answered:  Question  14  for  bomber 
pilots  and  co-pflots.  Question  IS  for  fighter  pilots.  Question  16  for  bombardiers  *od 
question  17  for  navigators. 
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(14)  Age  period  of  most  successful  combat  bomber  pilot*  sad  bomber  copOotj. 

(Based  oa  33$  esses,  36.6  percent  of  the  521  frit  they  wen  not  qualified  to 
answer.) 

JO  t  1S-19 
3J  3  20-21 
213  3  22-23 
$24  4  24-25 
14.1  $  26-27 
1J  6  21-29 
3  7  30-31 
jO  3  32-33 
3  9  34  or  over 

(15)  Age  period  of  most  successful  combat  fighter  pilot.  (Based  os  364  cases, 

31J)  percent  of  the  521  frit  tfcsy  were  not  qualified  to  saswer.) 

I. 1  1  11-19 
263  2  20-21 
500  3  22-23 
11.4  4  24-25 

3D  5  26-27 
13  6  21-29 

7  30-31 

8  32-33 

9  34  or  over 

(16)  Age  period  of  most  successful  combat  bombarcier*.  (Based  on.  309  cases, 

413  percent  of  the  528  frit  they  were  not  qualified  to  answer!) 

OD  1  11-19. 

73  2  20-21. 

333  3  22-23. 

393  4  24-25. 

II. 9  5  26-27. 

2.6  6  21-29. 

7  3031. 

8  32-33. 

9  34  or  over. 

(17)  Age  period  of  most  successful  combat  navigators.  (Based  on  319  cases, 

39.6  percent  of  the  528  frit  they  were  not  qualified  to  answer.) 


0.0  1 

18-19. 

21  2 

20-21. 

27D  3 

22-23. 

47.6  4 

24-25. 

19.4  5 

26-27. 

22  6 

23-29. 

3  7 

3031. 

3  8 

32-33. 

D  9 

34  or  over. 

How  long  were  you  overseas? 

2.1  1 

4  months  or  less. 

42  2 

5  or  6  months. 

** 

00 

7  or  8  months. 

32.8  4 

9,  10,  or  11  months. 

24.4  5 

12,  13,  or  14  months. 

15.7  6 

15,  16,  or  17  months. 

S.l  7 

18,  19,  or  20  months. 

3.0  8 

21,  22,  or  23  months. 

4.0  9 

24  or  more  months. 

S 

i 

i 
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(19)  How  but  mission  <fid  you  complete  outside  of  the  continental  United  States? 

(By  authority  of  the  Intefficeaoe  Officer  aB  men  are  permitted  to  answer  thfa 
qwutkaj 

44  1  10  or  less  / 

J4  2  11  to  20. 

M  J  21  to  IS. 

64  4  2*  to  JC. 

US  S  31  to  40, 

203  6  41  to  SOL 

164  7  51  to  60 

5.4  a  61  to  ?a 

17.4  9  mote  than  TO  . 

(20)  Row  many  combat  flying  hours  did  you  complete?  (By  authority  of  the  In- 

tetBgeace  Officer,  all  men  are  permitted  to  answer  this  question^ 
lid)  1  bJcw  100  hots*. 

42.4  2  105  to  200  hours. 

SOS  3  2C0  to  300  hours. 

124  4  300  to  400  hours. 

14  5  4 en  Co  SOG  hoars. 

14  6  500  to  600  hoars. 

.4  7  6C9  to  70Q  hoars 

A  8  TOO  to  tOO  hours 

ij  g  900  hours  or  more. 

(21)  Did  you  fly  more  or  less  than  the  regularly  required  number  of  missions  or  boon 

for  your  theater  and  type  of  plane?  (Write  only  one  cumber  Is  space  No.  21) 
94  1  flew  less  than  the  required  number  of  missions  or  hours 

294  2  Sew  exactly  tbe  required  number  of  missions  or  hours 

19.5  3  dew  more  than  the  required  number  of  missions  or  boors 

413  4  there  was  no  exact  policy  on  the  number  of  missions  or  hours  required 
or  do  not  know. 

(22)  In  wbat  theater  did  you  By  ail  or  most  of  your  combat  missions? 

16.7  1  European — (England-France). 

443  2  Mediterranean  (Italy,  North  Africa,  Middle  East). 

27.1  3  Pacific  (Central,  South,  Southwest). 

4.0  4  China-Burma-India.  , 

23  5  Caribbean. 

4j0  6  Alaska. 

.4  7  North  Atlantic — Greenland.  * ' 

1J  8  other  (if  you  flew  in  a  theater  not  listed  here,  write  its  name  oi.  tbe 

back  of  the  answer  sheet  after  No.  22). 

(23)  In  what  one  type  of  plane  did  you  fly  all  or  most  of  your  combat  missions? 

(Write  only  one  number  In  space  No.  23.) 

182  1  B-17. 

34  2  B-24. 

32.4  3  B-25. 

16.9  4  B-26. 

2.7  5  A-20. 

8.7  6  P-40. 

34  7  P-51. 

44  8  P-39. 

1.9  9  P-38. 

7.6  10  other. 

(If  you  flew  a  type  not  listed  here,  write  in  alternative  10,  and  -write 
Us  type  or  name  on  the  back  of  the  answer  sheet  after  No.  23.) 
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(24)  How  may  crash  landings,  forced  landings,  or  ditchings  bt  friendly  territory  bar* 

you  beta  la?  (Write  the  actual  dumber  in  space  No*  24  on  your  answer  sheet*) 

(25)  How  many  crash  landings,  forced  landings,  or  ditchings  in  enemy  territory  #r 

Uniiory  not  controlled  by  friendly  troops  have  you  b«o  ia?  (Write  the  actual 
number  in  space  Ko.  U  on  your  answer  sheet)  (By  authority  of  the  Integ- 
ftnee  Officer  all  returnees  may  answer  this  question.) 

(26)  On  what  proportion  of  your  missions  did  you  meet  enemy  opposition  of  some 

kind?  Opposition  h'ludes  dak,  fighters,  etc.  (Write  only  one  number  ia  tpu» 
No,  26.) 

4j0  £  neve?. 

4J  2  rarely. 

5.9  3  less  than  half  of  the  missions. 

16.7  4  half  or  more  of  the  missions, 

|  52.1  S  almost  every  mission. 

16.7  6  every  mission. ' 

!  (27)  Did  you  ever  “bail  out"  on  a  combat  flight?  (Write  only  one  number  In  wo 

No.  27.)  - 

i  4.0  1  yet;  over  friendly  territory. 

j  ’  2  yes;  over  enemy  territory,  or  territory  not  controlled  by  friendly  troops 

(by  authority  of  the  Intelligence  Officer,  returnees  may  give  this 
answer  if  it  is  true). 

i  .0  3  yes;  over  both  friendly  and  enemy  territory  at  different  times. 

I  93.6  4  no;  never  bailed  out 

j  (28)  Were  you  ever  wounded  in  combat?  (Write  only  one  number  in  spies  No.  28. 

;  If  you  were  wounded  more  than  once,  answer  for  the  worst  one.) 

j  10.0  1  slight  wound;  not  nospitalixed. 

4.0  2  slight  wound;  in  hospital  less  than  one  week. 

.6  3  moderately  severe  wound  but  not  hospitalized. 

23  4  moderately  severe  wouad;  in  hospiial  up  to  6  weeks. 

2.1  5  severe  wound;  in  hospital  more  than  6  weeks. 

80.7  6  was  never  wounded. 

(29)  While  on  foreign  service,  were  you  ever  injured  in  connection  with  aircraft  whOs 
not  in  combat?  (Write  only  one  number  in  space  No.  29.  If  you  were  b> 
jured  more  than  once,  answer  for  the  worst  injury.) 

6.6  1  slight  injury;  not  hospitalized. 

1.3  2  slight  injury;  in  hospital  less  than  one  week.  • 

1.4  3  moderate.'/  severe  injury;  not  in  hospital. 

1.7  4  moderately  severe  injury;  in  hospital  up  to  6  weeks. 

1.7  5  severe  injury;  in  hospital  more  than  6  week*. 

87.S  6  was  never  injured. 

(30)  How  much  were  you  bothered  by  air  sickness  while  in  combat? 

93.6  1  never. 

5.9  2  only  on  a  few  flights. 

.4  3  frequently. 

.2  4  on  nearly  every  flight 
.0  5  on  every  flight. 

R  (31)  While  on  foreign  service,  were  you  ever — (Mark  the  number  of  the  statement 

Ithat  applies  to  you.  Write  only  one  number  in  space  No.  31.) 

4.4  1  sent  to  a  hospital  because  of  operational  fatigue  or  exhaustion. 

13.6  2  sent  to  a  rest  camp  because  of  operational  fatigue. 

6.6  3  given  leave(s)  for  reason  of  operational  fati  ire. 

4.0  4  diagnosed  as  having  flying  fatigue  or  operation  '  fatigue,  but  not  treated 
for  it. 

24.6  5  sent  to  a  rest  camp  routinely,  not  for  operational  fatigue. 

;  19.5  6  never  had  operational  fatigue  nor  sent  to  a  rest  amp. 

27.1  7  given  routine  combat  leave, 
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(34)  Boy  sawy  o i  yam  dost  fnewds,  not  members  of  yam  tram,  were  x 

kiSed  or  wounded?  (Those  who  flew  m  the  suae  plane  are  not  to  be  cooadtnd. 
Write  ody  one  number  is  space  No.  34.) 

17.2  1  Uf  or  Bore  of  ibfa  w»ie  hT>^  or  wmkM. 

77-7  2  between  i  quarter  and  a  half  were  Kiyt  or  »«mwH 

34.7  3  several  w«e  missing,  killed  or  urcundcd,  bat  lean  tb»»  a  ejnazter. 

15U  4  only  a  few  were  missing,  k2!ed  or  jnxaxkd. 

7-5  5  no  dose  friend  was  missing,  killed  or  woumfcd 

(35)  What  was  the  principal  reason  for  your  being  returned  to  the  United  States  fnm 

an  overseas  theater?  (Write  only  one  number  in  space  No.  35.) 

55 J  1  rotation  poBcy ;  having  Sown  the  required  number  of  or 

183  2  returned  because  of  flying  fatigue,  after  completing  about  the  bm! 
number  of  missions  is  my  theater. 

2J  3  relumed  because  of  flying  fatigue  or  operational  fatigue  without  cm- 
pie  ting  the  usual  number  of  znisaom. 

3.4  4  wounded  in  action  or  injured  in  connection  with  aircraft. 

3.6  5  illness,  injury  or  operation  not  connected  with  aircraft. 

13  6  escaped  prisoner  of  war  or  evader  of  capture  (On  instructions  of  Intdfl- 
gence  officer  returnees  may  give  this  reason  if  it  Is  true.) 

SJ  7  returned  for  instruction  or  reascigrmynt 
S  8  personal  request  to  be  returned 

9.5  9  other  (Indicat.  «hat  on  back  of  answer  sheet  after  No.  35.) 

(36)  After  you  returned  from  overseas  duty,  were  you  processed  in  a  Redistribution 
Center  between  24  May  1944  and  6  August  1944?  (The  three  Redistribution 
Centers  are  at  Atlantic  City,  NJ.,  Miami  Beach,  Fla-  and  Sants  Monks, 
Calif.) 

25.9  1  not  processed  in  Redistribution  Center. 

5.9  2  processed  rt  Atlantic  City  between  24  May  1944  and  6  August  1944. 

83  3  processed  at  Miami  Beach  between  24  May  1944  and  6  August  1944. 

4.7  4  processed  at  Santa  Monica  between  24  May  1944  and  6  August  1944. 

S4.7  5  processed  at  Atlantic  City,  Miami  Beach  or  Santa  Monica  but  not 

during  period  24  May  1944  to  6  August  1^44. 
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(37)  Berm  loc?  km  yam  beex  m  this  cczzlij  dace  yarn  retired  from  6dtj  mnw?  { 

31  1  2  tr  km. 

123  2  3  me  4  rakH. 

13.1  3  S«ri  SM(k 

17.4  4 

13  J  5  fKX)  Mlk. 

13.4  *  11  «r  U  ackka. 

9J  7  13  *r  14  acaik 
13  S  15  or  li  ■ootko 
fj  9  17  aoKb  or  am. 

(33)  Which  oac  cf  tie  loBmrag  cn&kss  is  fke  Uaited  States  are  jroa  Mat  <3b- 
afirfri  with?  (Wiitt  eiijr  use  Rkxr  b  gaa  No.  U) 

443  1  tie  attiiodr  d  b&or  a  ties  coeatry. 

13  2  tie  rltterSf  cl  besaes  ud  ia&abal  anyor  k  Ufa  commit y. 

11.4  3  tie  pata!  alljtede  of  drSas  to  wSStaxy  petsaoad. 

12.9  4  tie  nice  cl  ts£5Sarjr  courtesy,  <rsripfipe  aad  t»nk»t  ia  tkb  tNSbf. 

13  5  rartnoiac 

133  6  tie  tttfad;  of  s£S!ry  ynetad  ark*  kave  urrer  bee*  ortcat 
.4  7  my  oara  family  refat:ca^np*. 

(39)  VTsuch  ooe  of  tie  fa3 owing  types  of  nqnmt  do  jo#  bare  at  prea eat? 

653  1  asijsast  involving  flying  duties  as  aa  ingiwrtor. 

16.9  2  isvokis;  Sying  duties  aat  as  aa  aatadar. 

53  3  2«fgmaest  involving  ground  duties  as  aa  iastrndae. 

123  4  assgnment  invehrieg  ground  duties  of  aa  adadcistiattie  aatert  (sot  aa 
aa  instructor). 

(40)  Which  one  oi  the  iolkrwmg  phrases  fof  describes  your  satisfaction  arirh  jroar 

present  assignment? 

273  1  very  sstisfsrtoiy. 

44.7  2  satisfactory. 

10j6  3  indifferent. 

133  4  unsatisfactory. 

4.0  5  very  unsatisfactory. 

(41)  In  your  opinion,  how  well  is  the  Army  sow  raking  use  of  your  abOity  aad 

experience?  (Indude  either  or  both  military  and  civilian  experience.)  . 

20.8  1  best  use  of  my  ability  and  experience. 

555  2  good  use  of  my  ability  2nd  experience. 

19.9  3  very  little  use  of  my  ability  and  experience. 

3.6  4  no  use  of  my  ability  and  experience. 

3  5  have  no  present  assignment 

(42)  Regardless  of  what  you  are  doing  at  the  present  time,  v'.nich  one  of  the  following 

types  of  assignment  appeals  to  you  most? 

33.1  1  assignment  involving  flying  duties  as  an  instructor. 

52.7  2  assignment  involving  flying  duties  not  involving  instructing. 

4.4  3  assignment  involving  ground  duties  as  an  instructor. 

9.8  4  assignment  involving  ground  duties  of  an  administrative  nature  (not  at 
an  instructor). 

(43)  Regardless  of  what  you  are  doing  at  the  present  ti  ».  which  one  of  the  following 

best  expresses  your  desire  relative  to  assignment  to  .-ying  duties  as  an  instructor? 

33.7  1  desire  assignment  to  flying  duties  as  an  instructor. 

33  3  2  indifferent  to  assignment  to  flying  duties  as  a  instructor. 

333’.  3  desire  not  to  be  assigned  to  flying  duties  a  n  instructor. 
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Beguiles  af  what  yw  an  doo*  at  tie  pro eat  time,  wiki  sat  of  the  /oEowi^ 
bat  etpttms  j*m  dean  ttblin  to  asggawwt  1*  flying  dado  a*  hwh^ 

laiuT—  to  Jyisg  doth*  art  iiotvfcg  iodrartif. 

32.4  2  iadMmat  to  «aig*mrrf  to  fymg  daks  »«  iannKiat  hrt«% 

U3  3  defca  at  to  be  aprf  to  «y»t  detfas  «*  togrfwag  tartraettag. 

(/J)  Kcgudka  of  ate  jw  are  doog  at  the  procat  time,  which  owe  e(  the  hBwj^ 
bat  aqpwra  jvar  drain  itblin  to  asagamewt  to  gf  d  im da  K  a  h 
stractar?  ' 

U  i  dean  aragmseat  to  grooad  dades  as  aa  iastractor. 
l(j  2  aifatat  to  to  frond  det*s  as  aa  krtnehr. 

jjj  j  drain  Ki  to  be  nyH  to  grooad  dntiq  as  aa  kutmi«. 


(44)  of  what  p»  an  dong  at  the  preseat  time,  which  owe  of  tie  fclowiag 

Twf#  espetaaa  jwr  desire  rthiht  to  assignment  to  pond  daet  of  aa  tdaaa. 
tzatxre  aatan  (not  as  aa  toatrartor). 

20  5  i  i frm  — to  grooad  (hides  of  aa  adwiahtratiwe  aatan  (a at 
fastrartcr). 

24 2  2  to  inipaKBt  to  ground  duties  of  a a  admimstratjrg  Baba* 

foot  fcutractor). 

S5J  3  drain  aot  to  be  assigned  to  pnu!  duties  cl  aa  admiartfratne  Baton 
(not  laatractor). 


(47)  How  strong  is  your  desire  to  remain  aa  firing  status? 
741  1  Toy  stnag. 

151  2  stnag. 

4:9  3  isfilrrraL 

11  4  somewhat  opposed  to  it.  -  ; 

A  5  strongly  opposed  tc  M. 

32)  6  set  es  fiyisg  Sacu s  at  present  *iaf. 


(48)  At  present,  how  modi  are  you  bothered  by  air  sickness? 

903  1  never. 

63  2  only  on  a  few  Sights. 

13  3  frequently. 

JO  4  on  nearly  every  flight. 

jO  S  oa  every  flight. 

23  6  not  on  flying  sutns. 

a 

(49)  Are  you  on  limited  service  at  the  present  time? 

94.7  I  no.. 

23  2  yes;  physical  ailment 

2.7  3  yes;  operational  fatigue  or  combat  fatigue. 

3  4  yes;  other  non-physical  reason  not  mentioned  in  3  above. 

It  has  been  suggested  that  the  following  factors  influence  officers’  feelings  relative  to 
returning  to  combat  duty.  Indicate  the  degree  to  which  each  of  the  following  factors 
influences  your  feelings  toward  returning  to  combat. 

(50)  Want  to  return  to  square  accounts  because  of  my  friends  who  have  been  wounded 

or  killed  overseas. 

13  1  influences  me  greatly. 

21.6  2  kflu?nc?3  me.  yomewhai. 

77.1  3  does  not  influence  me. 


(51)  Want  to  return  because  I  prefer  duty  in  combat  to  tbe  duty  to  which  I  am  do* 
assigned, 

11.0  1  Influences  inc  greatly. 

24.1  2  influences  me  somewhat. 

6S.0  3  does  not  influence  me. 


(52)  Wnt  to  trim  btanx  I  mm  dissatisfied  with  cu£tku  as  I  km  feud  them 

bets  la  tbe  Catted  Suits. 

9 J  1  fc  flamers  me  jrtjtJy. 

23 -f  2  !b£«m$  sac  scarvfat  ' 

o4J  3  dos  agt  bhtact  at 

(53)  1Tm<  to  ret  am  because  I  prefer  tobiktbe  aUdfc  of  ikhp  rather  tkte  «  ftt 

11.9  1  faflaences  at  grea fiy. 

3d J  2  faftwea  at  aanhL 

51.7  3  dees  sot  iaflueata  at  - 

(54)  Wkkk  oi  the  sUttsasts  below  best  describes  yoar  presegt  attitude  toward 

returning  to  combat  duty?  (Write  jdjr  oae  amahrr  *-  space  N*.  54.) 

12-S  1  would  retara  famanSatriy. 

3j0  2  would  retara  after  ooe  mere  math. 

3  J  3  avoid  retara  after  taw  more  aarti 
JJ  4  avoid  retara  after  three  more  aaftt 
13  5  avoid  retara  after  fear  more  bsoAl 

2.1  6  would  return  after  fire  more  swtki 
392)  7  weald  retara  after  six  more  moatta. 

2ZJ0  8  would  not  retara  under  any  riroemstaaces. 

the  degree  to  which  each  of  the  following  factors  faftnrsee*  yoor  fedap 
titwui  returning  to  combat. 

(55)  Do  not  meet  to  return  because  of  family  ties  and  obBgaticae. 

43.4  1  influences  me  greatly. 

322)  2  influences  me  somewhat. 

24.6  3  does  not  Influence  me. 

(56)  Do  not  want  to  return  because  I  fed  I  have  contributed  ray  share  In  combat. 

17.6  1  influences  me  greatly. 

322)  2  influences  me  somewhai. 

50.4  3  does  not  influence  me.  .  ' 

(57)  Do  not  want  to  return  because  I  fed  I  could  not  stand  up  under  the  strain  of 

further  combat. 

14.6  1  influences  me  greatly. 

258  2  influences  va  somewhat.  i  • 

595  3  does  not  influence  me.  . 

(58)  To  what  extent  do  you  feel  that  your  stay  in  the  United  States  since  returning 

from  combat  ddty  has  afiected  your  efficiency  for  future  duty? 

24.4  1  increased  my  efficiency  considerably. 

30.1  2  increased  my  efficiency  somewhat. 

28.4  3  no  effect  on  my  efficiency. 

11.4  4  decreased  my  efficiency  somewhat. 

5.1  5  decreased  my  efficiency  considci«u*r. 

(59)  In  your  opinion,  how  long  should  an  officer  returned  from  combat,  (and  physically 

qualified  for  overseas  duty)  :emain  in  the  United  States  before  going  back  for 
a  second  tour  of  combat  duty?  On  making  your  judgment,  do  not  include 

time  in  hospital.)  ,  ' 

.4  1  less  than  1  month. 

1.7  2  between  t  and  2  months. 

2.5  3  between  2  and  3  months. 

13  4  between  3  and  4  months. 

1.1  3  between  4  and  5  months. 

93  6  between  5  and  6  months. 

10.6  7  between  6  and  7  months. 

9.8  8  between  7  and  8  months. 

61.7  9  more  than  3  months. 
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MO)  Hi*  strong  k  jrw  desire  U  relane  to  ewikt  duty? 

Si)  1  very  strong  desire  to  retwm. 

21  A  2  tame  daft*  to  return. 

21H  3  hdfmst  as  to  returnbg  {sot  fee  «r  aptot). 

22  J  4  uat  dedrt  «wt  to  retwm. 

i?J  S  very  stron g  desire  not  to  retwm. 

Ml)  If  Ike  AAF  makes  k  posable  for  joe.  to  nhaUtr  for  a  aecoad  torn  of  com!*' 
would  jm 

W  1  vofmtesr  lot  aecoad  torn  fr— nSitftj 

3.4  2  vetaoteer  for  aecoad  tow  -fter  oae  more  month. 

3J3  3  vcfaattcr  for  second  tow  after  two  more  aoatik 

33  4  volunteer  for  second  tow  after  three  more 
13  5  volunteer  for  second  tow  after  fow  more 

13  4  volunteer  for  second  tow  after  five  more  — hp 

17.2  7  volunteer  for  second  tow  after  six  more 
5S-S  S  deefine  to  volunteer  lor  a  aecoad  tow. 

(62)  Some  men  returned  from  combat  have  indicated  that  certain  conditions  sock  as 

the  food,  recreation,  etc,  in  the  overseas  theater  were  very  unsatisfactory.  l\ey 
also  indicated  that  if  these  conditions  were,  improved,  they  would  have  a  greater 
desire  to  return  to  combat.  Which  one  of  the  following  conditions,  if  imjmin <1^ 
would  increase  your  desire  to  return?  Mark  only  the  one  number  you 
the  men  important.  (Write  only  one  number  in  space  No.  62.) 

56.1  1  food. 

1G-1  2  firing  quartets. 

17J  3  rest  and  recreational  farifitka. 

3.0  4  sanitary  conditions  (control  of  disease). 

’  i*  S  medical  cate. 

3.<  6  longer  time  between  mli&M 

Irrespective  of  your  past  training  and  experience  would  you  be  moi-'  willing  to 
return  to  combat  if  you  were  assigned  to  any  one  or  more  of  the  following  «hfr«  Be 
sure  to  answer  every  question. 

(63)  Single  engine  fighters. 

41.7  1  yes. 

S7j6  2  no.  , 

(64)  Twin  engine  fighters.  t 

43j0  I  yes. 

56.4  2  no. 

(65)  Attack  bombers. 

28.2  1  yes. 

71.4  2  no. 

(66)  Medium  bombers. 

29.2  1  yes. 

70.5  2  no. 

(67)  Heavy  bombm. 

13  A  l.  yes. 

85.5  2  no. 

(68)  Very  heavy  bomber*. 

33.5  1  yes. 

66.1  2  no. 

(69)  Reconnaissance. 

21.2  1  yea. 

78.2  2  no. 
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(70)  Would  yoM  be  mote  «Hb|  tc  ,ttjn  ortnot  If  prtn  u  mlpant  not  iavohr- 

ing  frequent  combat  Hying? 

574  1  yea. 

4  2j0  2  a*. 

(71)  Would  700  be  more  wflfiag  to  retain  to  combat  if  some  cf  tie  other  member 

of  tbe  cmr  abo  bad  previously  cooopJct ed  a  tour  of  combtt  duty? 
ili  1  ye*. 

Mi  2  m. 

* 

(72)  Do  you  bare  a  permanent  grade  »  tbe  Regular  Amy,  National  Guard  or  Re* 

serve  Corps? 

6.1  1  yes;  an  enlisted  grade  k  tbe  Regular  Amy.  - 
J  2  yes;  a  commissioned  grade  in  tbe  Regular  Amy. 
jO  3  yes;  as  enlisted  grade  la  tbe  National  Guard.  ' 

J  4  yes;  a  commissioned  grade  ir  tbe  National  Guard. 

J  5  yes;  an  enlisted  grade  la  tbe  Reserve  Corps. 

69 J  6  yes;  a  commissioned  grade  in  tbe  Reserve  Corps. 

23  J  7  no;  do  not  have  any  permanent  grade. 

(73)  At  tbe  end  of  the  present  national  emergency,  do  you  desire  to;  , 

59  J  1  remain  on  active  duty  with  tbe  Air  Forces  (Regular  Amy)  ? 

37.1  2  return  to  civilian  fife  in  an  Amy  Reserve  Officer  status? 

34  3  return  to  dvifian  fife  without  retaining  Amy  Reserve  Officer  status? 

(74)  If  you  were  given  a  choice  of  your  future  assignment  during  the  present  oner* 

gency,  do  you  have  a  specific  assignment  in  mind  which  you  would  most  prefer? 
564  1  yea. 

33.7  2  so. 

94  (if  your  answer  is  “yes,”  write  this  specific  assignment  on  tbe  bad  of 
the  answer  sheet  after  No.  74.) 

(75)  Have  you  attended  any  Army  school  other  than  the  regular  bombardier,  navi¬ 

gator  and  pilot  (primary,  basic,  advanced)  schools? 

42j6  1  yes.  v 

57.4  2  no. 

(If  your  answer  is  “yes,”  write  the  type  of  school  or  schools  attended 
on  the  back  of  the  answer  sheet  after  No.  75). 

(76)  If  it  were  possible  for  you  to  get  further  training  or  attend  an  Army  technical 

school,  would  you  be  interested  in  any  one  or  more  of  the  following.  Indicate 
your  choice  (s)  on  the  back  of  the  answer  sheet  after  No.  76.  List  any  others 
you  may  wish. 

1  pilot  training. 

2  bombardier  training.  , 

3  navigator  training. 

4  engineering  school. 

5  radio  school.  , 

6  weather  schooL 

7  gunnery  school. 

8  combat  intelligence. 

(77)  If,  at  some  future  time,  it  were  possible  for  the  Air  Corps  to  set  up  s  training 

program  which  would  not  necessarily  be  limited  to  Army  specialties  would  you 
be  interested  in  going  to  school  for  three  (3)  to  six  (6)  months? 

1  yes. 

-  2  no.  ,  ,  ,  , 

(If  your  answer  is  "yes,”  list  in  order  of  preference  on  back  of  answer 

sheet  after  No.  77  the  th.ee  (3)  courses  which  you  would  like  to  take. 
Remember  that  these  preferences  need  not  neccss  !y  be  related  or  limited 
to  Army  specialties. 
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Appendix  L2 

Gcmrear  Qoz*no?o»Ai2* 

(Based  aa  2659  cues  aafcss  oUterwisc  Indicated) 

His  yadasafa  is  tc  determine  and  record  year  experiences  sad  epfadoas  as  s 
returned  cambat  gunner.  He  Amy  Air  Force  b  vitally  lete rested  in  finding  oat  year 
rcactioa  to  your  training,  to  what  you  have  doce  and  seen  while  Le  combat,  and  to  year 
praeat  Ideas  This  questionnaire  b  not  to  be  considered  siJie?  Uad  Hat  rather 
as  a  record  of  what  you  have  sees,  what  yoa  have  done,  aad  what  y««  think. 

You  will  find  that  the  questions  may  be  answered  by  irxfi  eating  the  rnnnber  of  mt 
of  the  alternative  answers  b  the  space  provided  on  the  answer  sheet  Be  sore  that  yoe 
write  the  mn»W  indicatbg  your  answer  in  the  space  corresponding  to  the  question. 
However,  in  some  of  the  questions  you  wOl  find  that  the  alternatives  listed  do  not 
give  your  answer.  Instructions  are  pvee  with  these  questions  to  write  yarn  answer 
in  the  space  provided  on  the  beck  of  your  answer  sheet  Read  the  question  and  ai  of 
the  alternative  answers  before  answering  the  question.  If  none  of  the  alternative 
answers  ir  satisfactory  to  you,  raise  your  hand  and  the  administrator  will  gladly  hdp 
you.  Do  not  skip  any  question.  Answer  each  one  to  the  best  of  your  abffity. 

The  booklet  of  questions  w3'  be  used  again  for  another  returned  gunner.  Therefore, 
you  are  requested  not  to  make  any  pencil  marks  upon  it  or  deJ  ice  it  in  any  way. 
Write  your  serial  number,  present  post  or  nelc  and  dite  on  the  answer  sheet  ia 
the  provided  and  then  proceed  with  the  fin*  question.  There  will  be  no  time 
Wt  When  you  have  finished,  please  raise  you:  hand. 

The  first  question  asks  “What  is  your  present  grade?”  Under  the  question  b  a  fet 
of  grades  from  blaster  Sergeant  to  Private.  Pick  out  your  present  grade  and  write  the 
number  corresponding  to  it  on  the  list  of  alternative  answers  in  the  space  under  “1" 
on  your  answer  sheet.  Continue  in  the  same  manner  for  the  remainder  of  the  questions. 
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(Percentage  distribution  of  answers  b  Indicated  in  margin.) 

(1)  What  is  your  present  grade?  (Write  Jie  correct  number  in  space  No.  1.) 

1.5  \  Master  Sergeant 

A  2  First  Sergeant  t 

36.4  3  Technical  Sergeant  < 

56.6  4  Staff  Sergeant 

2.7  5  Sergeant 
.7  6  Corporal. 

.1  7  Private  First  Class. 

1.1  8  Private. 

(2)  What  Is  your  age  in  years,  to  your  nearest  birthday?  (Write  it  in  space  No.  2.) 

(3)  Before  you  entered  the  Army,  how  far  along  In  school  did  you  g  i? 

1.7  1  Less  than  the  eighth  grade. 

8.1  2  completed  the  eighth  grade. 

18.0  3 
60.3  4 

5.7  5 

3.6  6 

1.2  7 

1.1  8 

.1  <) 

.0  10 

2  0 

340 


ore  or  two  years  in  high  school  or  vocational  school, 
three  or  four  years  in  high  school  or  vocational  school, 
one  year  in  college, 
two  years  in  college, 
three  years  in  college. 

four  years  in  college  or  graduated  from  college., 

did  post  graduate  work  in  college  or  university. 

attended  or  graduated  from  professional  school  (denial,  medical,  etc.) 


* 


(4)  I*  ftaml,  bow  were  your  grade*  Is  schools  you  attended  before  am* lag  fa to 

tbe  Army?  (Write  only  one  cumber  is  the  apace  No.  4.) 

0l7  1  superior. 

20.4  2  above  mngt 

714  S  average.  - 

S  4  bekw  average.  | 

J  J  failing.  '•  ! 

J04  0  1 

•  •  *  '  i 

(5)  Are  you  married  or  single?  (Write  only  one  number  is  Space  No.  54  I 

S4J  I  single.  ; 

1  2  widowed. 

11  3  divorced  or  separated  other  than  by  military  necessity. 

191  4  married,  before  going  oversea*. 

3  5  married,  tokSe  oversea*.  '  ! 

233  6  married,  since  returning  from  overseas.  j 

(6)  How  many  living  children  do  yon  have?  *  ' 

-  ’ 

9jS  1  «oa  ! 

13  2  two. 

A  1  thrse. 

j04  4  four. 

JO  5  five  or  more. 

87.5  6  none. 

1.4  0 

*  *  .  •  1 

(7)  What  was  your  reaction  at  tbe  time  you  first  learned  that  you  were  assigned 

to  gunnery  training?  (Write  only  one  number  in  space  No.  7.)  .  * 

301  1  highly  pleased. 

411  2  pleased.  , 

121  3  indifferent 

2.4  4  displeased.  ' 

.9  S  very  unhappy. 

9j0  6  never  had  gunnery  training. 

3j6  0 

(8)  In  which  one  of  the  following  fields  of  gunnery  do  you  think  you  could  have 

benefited  most  by  additional  training  belore  being  sent  into  combat?  (Write 
only  one  number  in  space  Ns.  8.) 

10.5  0 

581  1  air  to  air  firing. 

1.9  2  machine  gun  ground  firing. 

9.1  3  turret  operation. 

.8  4  intercommunication  training  (intercom). 

2.1  5  range  estimation. 

7.6  6  sights  or  sighting. 

2.9  1  in  no  fields. 

3.0  8  parachute  and  escape  procedures. 

3.8  9  other  (If  not  listed  above,  write  what  field  on  the  back  of  the  answer 

sheet  after  No.  8.) 

'  io  never  had  gunnery  training. 
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(9)  After  guaoey  training,  but  before  you  were  actually  assigned  to  go  oa 

s  mission,  bow  did  you  M  about  getting  Into  combat? 

U  • 

35.7  i  favored  it  very  mack 
J14  *  favored  it  moderately. 

104  1  favored  It  a  ffttk. 

14.7  4  indifferent — neither  for  nor  against  H. 

2.7  S  against  it  sEghtfy. 

9  6  against  it  moderately. 

4  7  against  it  vety  mock. 

.  S.7  t  never  had  gunnery  training. 

(10)  What  was  your  principal  duty  during  most  of  your  time,  in  combat  theaters? 

(Write  only  one  number  in  space  Ho.  10.) 

26.4  1  gunner  end  mechanical  specialist  (engineer,  crew  chief,  mechanic,  etc). 

2 1.1  2  gunner  and  radio  or  radar  specialist 

35.9  3  gunner  and  armorer. 

9  4  gunner  and  photographer. 

4  3  gunner  and  fire  control  specialist. 

4  6  gunner  and  remote  control  turret  mechanic 

13.9  7  gunner  only. 

9.9  0 

(11)  If  you  received  any  training  in  special  fields  other  than  gunnery  such  as  arma¬ 

ment,  radio,  mechanics,  etc.,  either  in  the  Ur’tcd  Slates  or  overseas,  was  it 
sufficient  for  your  needs  in  combat?  (Write  only  one  number  in  space  No.  li.) 

21.1  1  sufficient  in  all  phases. 

434  l  sufficient  in  most  phases.  '  ; 

13.1  3  sufficient  in  a  few  phases. 

5.7  4  entirely  insufficient 

154  5  did  not  receive  training  in  fields  other  than  gunnery. 

.7  0 

(12)  How  much  use  did  you  make  in  combat  of  the  training  you  received  (both  in  the 

United  States  and  overseas!  in  the  special  field  other  than  gunnery  such  as 
armament,  radio  operation,  airplane  mechanics,  and  other  similar  fields.  (Writ* 
only  one  number  in  space  No.  12.) 


14 

0 

144 

1 

very  extensive  use. 

28.0 

2 

wide  use. 

42.0 

3 

some  use. 

7.0 

4 

no  use. 

74 

5 

received  no  training  other  than  gunnery. 

(13)  After  you  were  assigned  to  a  combat  crew,  which  one  of  the  following  reasons 
was  the  strongest  in  keeping  you  there?  (Write  only  one  number  fn  space 
No.  13.) 

13.3  1  thought  it  was  the  best  way  to  strike  an  active  blow  against  the  enemy. 

46.4  2  desired  to  do  a  good  job  and  contribute  my  share. 

4.1  3  didn’t  v/ant  to  let  the  other  members  of  the  crew  down  by  quitting. 
9.3  4  liked  the  excitement  of  combat  jjunnery. 

2.1  5  performed  the  duties  because  I  didn’t  want  to  be  called  a  quitter. 

214  6  preferred  flying  duty  to  ground  duty. 

1.6  7  war  ted  the  extra  money  from  flight  duty. 

1.1  8  performed  the  duties  only  because  I  was  ordered  to  dcs  so. 

.5  0 
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(14)  Judging  from  your  experience  la  combat  from  which  or.<  of  the  folk) wifi*  «** 

periods  dc  the  most  successful  combat  gunners  come?  Make  your  judgement  Ofi 
the  basis  of  the  performance  of  the  gunner  in  combat  (Write  only  one  num- 
*  ber  In  space  No.  14.) 

43  1  18,  19. 

27. 7  2  >0,21. 

40.1  3  22,  23. 

19.7  4  .'’4,  25. 

3.9  5  id,  27. 

1.4  6  28,  29. 

U  7  30  or  over. 

LS  0 

(15)  How  long  were  you  oversear. 

.4  12  months  or  less. 

.9  2  3  or  4  months.  , 

5.7  3  5  or  6  months. 

16.7  4  7  or  8  months. 

34.2  5  9,  10,  or  11  months.  ,  ' 

193  6  12,  13,  or  14  months. 

7jS  7  15,  16,  or  17  months. 

4.9  8  18,  19,  or  20  months. 

90  9  21  or  more  months. 

(16)  How  much  time  was  there  between  your  first  combat  t.  jsion  and  the  completion 

of  your  last  mission? 

43  1  2  months  or  less. 

93  2  3  or  4  months. 

23.7  3  5  or  6  months. 

24.4  4  7  or  8  months. 

233  5  9,  10,' or  11  months: 

7.9  6  12,  13,  or  14  mor'.as.  *. 

2.6  7  15,  16,  or  17  months. 

13  8  18,  19,  or  20  months. 

13  9  21  or  more  months. 

13  0 

(17)  How  many  mbat  missions  did  you  complete? 

6.1  1  10  or  less. 

3.9  2  11  to  20. 

23.6  3  21  to  25. 

113  4  26  to  30. 

103  5  31  to  40. 

273  6  41  to  50. 

123  7  51  to  60. 

1.6  8  61  to  70. 

13  9  More  than  70. 

13  0 

(18)  Did  you  fly  more  or  less  than  the  regularlv  reruired  number  of  missions  or  hours 

for  your  theater  and  type  of  plane?  (Write  only  one  number  in  space  No.  18.) 

10.8  1  flew  less  than  the  required  number  of  mis  ;ns  or  hours. 

51.4  2  flew  exactly  the  number  of  missions  or  hours. 

163  3  flew  more  than  the  required  number  of  missions  or  hours. 

2o J  4  there  was  no  exact  policy  on  the  number  of  .ssions  or  hours  required 
or  do  not  know. 
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Ctf)  !■  «ta  Ante  *i  y—  *y  *1  «c  *mj*  of  jwr  <«M  iM 
Si  1  bnpM  (l^M.  . 

JU  2  1 Mfccmtt  04r.  Nirtk  AHa,  Mitft  Ewt). 

IAJ  S  hdk  (Central,  SmA.  Sttehnaf). 

JJ  4  CM—  Ini  Till  .  . 

U  S  ChHUr— 

AS  f  Abate. 

4  T  Iforfk  iUbde-GmML 

3  g  (O  yon  lev  Sn  a  ftnlff  Ml  Estcd  hoc,  wrSu  As  name  «  the 

teck  of  the  snowir  *«t  after  No.  1*3  - 

(JO)  ia  wteC  —e  type  of  phae  dH  yon  «y  al  ee  mo*  «f  yew  caste*  afatei? 
(Write  only  — e  a— tiff  ia  spooe  He  JO) 

SSLS  I  B4f. 

21A  J  AK 
13J)  J  B41 
6.4  4  B4i 
24  J  A-JOL  ' 

3  4  B34. 

(21)  As  aa  aerial  gunner,  what  was  yew  position  ia  the  phae  ant  of  the  ttee? 

(Write  only  «ae  amber  ia  —a  Ne  2L) 

32  1  ease  pa  r  ease  tenet.  ' 

264  2  top  (aa  cc  tap  tarreL  .  .  .  ) 

103  3  nfit  operator^  pa. 

133  4  bottom  gun  or  bel  tarret. 

24.4  5  w*bt  gun. 

20.4  6  tai  (a  or  but  tarret. 

3  7  other  (If  you  fired  from  a  position  act  fisted  here,  write  location  oa  the 

bade  of  tte  answer  fbett  after  No.  21.) 

4 

(22)  From  your  experiences  is  combat,  which  gunner’s  position  would  you  tsy  is  the 

most  dangerous?  (Write  only  one  number  Lr  space  No.  22.) 

94  1  box  gun  or  nose  tumt. 

4.7  2  top  gun  or  top  turret. 

A  3  operator's  gun. 

£2  4  bottom  gunner  ball  turret. 

1S3  6  waist  gun. 

143  6  tall  gun. 

2  7  other  (If  it  is  a  position  not  fisted  above,  write  its  location  oa  the  fine 
after  No.  22.) 

432  8  all  gun  positions  are  equally  dangerous. 

4  C 

\ 

(23)  Were  you  ever  in  a  crash  landing,  forced  landing,  or  “ditching1’  that  caused 

injury  to  any  person?  (Wr't  only  one  number  in  space  No.  23.) 

J07  0 

23.7  1  yes;  in  friendly  territory. 

43  2  yes;  in  enemy  territory,  or  territory  not  controlled  by  friendly  group*. 

1.7  3  yes;  in  both  friendly  and  enemy  territory  at  different  times. 

56.7  4  no;  never  had  a  crash  landing. 

13.0  5  had  a  crash  landing,  forced  landing  or  ditching  but  no  one  injured. 
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t'M)  0*  whst  proportion  e (  jrear  ahstaa*  dU  yea  sect  may  eypwitlw.  of 
kind?  Oppoiklo*  isdwdcs  fak.  fighters,  etc.  (Wriu  «aiy  Me  aaUt  la 
Ka.2Q 
OS  0 

JjO  1  *rw. 

LS  2  rarely. 

2J  3  Jt»  tbtM  ha*f  ei  tie : 

I  ID  4  half  or  men  of  tie 
445  S  almost  every  aMa. 

352  I  mgr  aiafea. 

(25)  Did  yoa  mr  "Tail-oat"  on  a  com' 

No.  25J 

3J  1  yes;  over  friendly  territory. 

y  2  yes;  over  enemy  territory,  or  territory  sot  controlled  by  £rle«Hy 
troops  (by  authority  of  the  Intelligence  office,  returnee  may  jw  this 
answer  if  it  is  true). 

yes;  over  both  friendly  and  enemy  territory  at  different  times, 
no:  never  bailed  oat.  , 


Eight?  (Write  only  one  mrmber  la 


J 

922 

2 


3 

4 
0 


(26)  Were  you  ever  wounded  in  combat?  (Write  only  one  number  in  space  No.  26, 

if  yea  were  wounded  more  than  once,  answer  for  the  worst  ore. 

<U  0  _ 

11.9  l  slight  wound ;  not  in  hospital,  or  in  bospetal  less  than  one  week. 

32  2  moderately  severe  wound;  ;n  hospital  up  to  6  weeks. 

2.6  3  severe  wound;  in  hospital  more  than  6  weeks.  * 

802  4  was  never  wounded. 

1.8  5  received  mt-  ’enOely  severe  wound  but  was  not  hospitalised. 

(27)  While  on  foreign  service,  were  you  ever  injured  in  connection  with  tfrsraft 

while  not  in  combat?  (Write  only  one  number  in  space  No.  27.  If  you  were 
injured  more  than  once,  answer  for  the  worst  injury.) 


10.1 

12 

A 

87.7 

2 


slight  injury;  not  in  hospital,  or  in  hospital  less  than  1  week, 
moderately  severe  injury;  in  hospital  up  to  6  week*, 
severe  injury;  in  hospital  more  than  6  week*, 
was  never  injured. 


(28)  How  much  were  you  bothered  by  air-sickness  while  in  combat? 

76D  1  sever. 

202  2  on  only  a  few  flight*. 

2.9  2  frequently. 

.6  4  on  nearly  every  flight 
2  5  on  every  flight 

m  W Me  on  foreign  service,  were  yon  eve,-  (Mark :  (he  »»mber  of  He  final 
statement  that  applies  to  yon.  Write  only  one  number  In  space  No.  29.) 


2.7 

22.5 

12.1 

n 

21.3 

33.0 


1  sent  to  a  hospital  because  of  operational  fatigue  or  exhaustion. 

2  sent  to  a  rest  camp  because  of  operational  fatigue. 

3  given  furioMgh(s)  for  reason  of  operational  fatigue. 

4  diagnosed  as  having  flying  fatigue  or  oper.  -nal  fatigue,  but  not  treated 

5  senttif'a  rest  camp  routinely,  not  for  operational  fatigue. 

6  never  had  operational  fatigue  nor  went  to  .  rest  camp. 


J!  0 
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(30)  Vnt  aay  W  jrow  at*  uta  killed  la  tW  pbaes  U  which  jro*  flew?  (Write 

«*tr  m*  Masher  hi  9«t  N*.  J&) 

144  1  In  UM 
)J  2  2wmkifc& 

U  2  )«mUM 
LI  4  4  *tn  UM. 
ji  5  3  nt  Met 
J  4  (vtnUU. 

4  T  7  wm  UM. 

J  t  t  wo*  UM. 

763  9  aoat  was  UM. 

JO 

(31)  Wm  say  of  your  crew  mates  wounded  ia  the  plaoes  in  which  you  flew?  (Write 

only  owe  somber  ia  space  No.  31.) 

35.4  1  1-2  were  wounded. 

15j6  2  3-4  were  wounded. 

11  1  U  were  wounded. 

U  4  7-4  wm  wounded. 

J  5  9-10  were  wounded. 

£  6  11-12  wm  wounded. 

J  7  13-14  were  wounded. 

3  8  15-16  wm  wounded  or  mere. 

413  9  none  wm  wounded. 

(32)  How  (fid  the  death  or  wounding  of  your  crew  mates  affect  your  desire  to  remab 

on  combat  duty? 

6-2  0  '  .  . 

5.9  1  greatly  increased  my  desire  for  combat  duly. 

12.4  2  somewhat  increased  my  dean  fo’  .mbat  duty. 

35.1  3  didn’t  affect  my  desire  for  combat  duty. 

143  4  somewhat  decreased  my  desire  for  combat  duty.  • 

53  5  greatly  decreased  my  desire  for  combat  duty. 

20.7  6  none  of  my  crew  mates  were  lulled  or  wounded. 

(33)  How  many  of  your  close  friends,  not  crew  mates,  were  missing,  killed  or  wounded? 

(Those  who  flew  in  the  same  plane  are'  not  to  oe  considered.  Write  only  one 
number  in  space  No.  33.) 

35.9  1  half  or  more  of  them  were  missing,  killed  or  wounded. 

233  2  between  a  quarter  and  a  half  were  missing,  killed  or  wounded. 

22.0  3  several  were  missing,  killed  or  wounded,  but  less  than  a  quarter. 

14.9  4  only  a  few  were  missing,  killed  or  wounded, 

3.6  5  no  dose  friend  was  missing,  killed  or  wounded. 

.4  0 

(34)  In  general,  how  well  did  you  like  your  job  as  an  aerial  gunner  while  m  combatf 
322  1  liked  It  very  much. 

333  2  liked  it  somewhat 

22.9  3  indifferent — neither  liked  or  disliked  it 

7.6  4  disliked  it  somewhat 
24  S  disliked  it  very  much. 

.9  0 

(35)  What  was  the  principal  reason  for  your  being  returned  to  the  United  States 

from  an  overseas  theater?  (Write  only  one  number  in  space  No.  35.) 

63.2  1  rotation  policy ;  having  flown  the  required  number  of  missions  or  hours. 

19.9  2  returned  because  of  flying  fatigue,  after  completing  about  the  usual 

number  of  missions  in  my  theater, 

3  46 


i 

i 


4 


% 

'< 


i 

l 


U  3  returned  became  of  flying  fatigue  or  op~4tional  fatigue  without  com¬ 
pleting  tie  usual  number  of  mhrioua. 

2.6  4  wounded  la  action  or  injured  la  connection  with  aircraft. 

1.1  5  Dicta,  Injury,  or  operation  not  connected  with  aircraft. 

4.9  6  escaped  prisoner  of  war  or  evader  of  captce  (On  Instruction*  of  In¬ 
telligence  Officer,  returnees  may  give  this  reason  tf  it  Is  tree) 

6.1  7  other  reason.  (Write  what  oa  the  back  of  the  answer  sheet  after  No.  35.) 
0.9  0 

(36)  How  long  have  you  been  la  this  country  since  you  returned  from  duty  overseas? 

0.4  1  less  than  1  month. 

3.7  2  1  month. 

6.4  3  2  months. 

9.6  4  3  months. 

10.0  $  4  months. 

12.5  6  S  months  v 

13.0  7  6  months. 

8.0  8  7  months 
363  9  more  than  7  months.  . 

(37)  How  do  you  feel  about  the  duration  of  the  furlough  and  rest  period  given  you 

upon  your  return  to  the  United  States  and  before  you  were  reassigned  to  active 
duty? 

433  1  much  too  short. 

31.0  2  just  a  little  too  short. 

22.1  3  about  right 

.6  4  just  a  little  too  long. 

.1  5  much  too  long. 

23  6  no  furlough  or  rest  period  given  me. 

.4  0 


(38)  What  is  your  present  MOS?  (Military  Occupation  Specialty.) 

2.1  1  do  not  know. 

8.6  2  611-aerial  gunner. 


313  3  612-airplane  armorer. 

213  4  748-army  airplane  mechanic-gunner. 

153  5  757-AAF  radio  operator-roecbanic-gunner. 

.1  6  580-remote  control  turret  mechanic. 

.0  7  960-rcmote  control  turret  mechanic 
.0  8  940-army  aerial  photographer. 

2C.2  9  other.  (If  not  listed  above  write  MOS  number  and  job 
of  the  answer  sheet  after  no.  38.) 


title  on  the  back 


.4  0 

(39)  Since  you  returned  to  the  United  States  how  many  Jobs  have  you  had  on  which 
you  have  worked  a  week  or  longer? 

59.1  1  1  Job. 

213  2  2  Jobs. 

7.0  3  3  jobs. 

2.1  4  4  Jobs. 

3  5  5  jobs. 

.16  6  jobs. 

.17  7  Jobs. 

.4  8  8  jobs  or  more. 

8.1  9  no  job. 

2  0 
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(40)  Which  ef  tie  following  best  describes  your  major  duty  assignment  dace  y* 

bare  returned  to  the  United  States? 

57.1  1  instructor  on  dying  states. 

20?  2  ground  instructor  in  gunner,  armament,  radio,  etc. 

24  3  instructor  other  than  1  or  2. 

9.7  4  armament,  radio,  mechanic,  etc.  (ground  duty  but  not  instructing.) 

J  5  clerical  or  admiahtrethra. 

4  6  public  relations. 

4  7  in  hospital. 

4.4  S  no  assign  meat. 

32  9  other.  (Write  what,  on  back  of  answer  sheet  after  No.  4a) 

4  0 

(41)  la  your  opinion,  how  well  is  the  Army  cow  making  use  of  your  ability  and  ex¬ 

perience  other  than  in  combat  gunnery,  military  or  pre-war  experience  such  u 
armament,  radio,  clerical,  administrative,  etc 
254  1  best  use  of  my  ability  and  experience 

46.7  2  good  use  of  my  ability  and  experience 
164  3  very  little  use  of  my  ability  and  experience 

74  4  no  use  of  my  ability  and  experience 
44  5  no  assignment  has  been  given  to  me 
A  Q 

(42)  Which  one  of  the  following  phrases  best  describes  your  satisfaction  with  your 

present  assignment? 

224  1  very  satisfactory. 

45.7  2  satisfactory. 

144  3  indifferent. 

IOjO  4  unsatisfactory.  ; 

64  5  very  unsatisfactory. 

J9  0 

-  (43)  How  well  do  you  think  you  are  performing  the  duties  of  your  present  assignment? 
54  1  outstandingly. 

654  2  wdL 
254  3  acceptably. 

14  4  poorly. 

14  5  very  poorly. 

14  6 

\  * 

(44)  Do  you  feel  that  your  services  as  a  combat  gunner  are  of  more  value  in  winning 

the  war  thnr  'he  services  you  are  performing  in  your  present  job? 

124  1  services  as  a  combat  gunner  very  much  more  valuable 

10.1  2  services  as  a  combat  gunner  somewhat  more  valuable 

34.7  3  services  as  a  combat  gunner  of  equal  value  to  services  oe  present  job. 

19.4  4  services  as  a  combat  gunner  somewhat  less  valuable 

20.0  5  services  as  a  combat  gunner  very  much  less  valuable. 

2.9  6  0 

(45)  Which  one  of  the  following  conditions  in  ;he  United  States  are  you  most  dis¬ 

satisfied  with?  (Answer  only  one  uumber  in  space  No.  45.) 

1.0  0 

18.6  1  the  attitude  of  labor  In  thU  cor’-,'  ", 

5.9  2  the  attitude  of  business  and  industrial  management  in  this  country. 

11.7  3  the  general  attitude  of  civilians  to  military  personnel. 

15.0  4  the  nature  of  military  courtesy,  discipline  and  training  in  thu  country. 

2.1  S  rationing. 


I 


31.1  6  tl>e  attitude  of  military  personnel  who  have  never  been  oversea*. 

1.9  7  my  own  family  relationship*. 

12 J  8  not  dissatisfied  with  any  condition  in  the  United  States. 

(46)  Bow  strong  is  your  desire  to  remain  on  flying  status? 

US  1  very  strong. 

24.9  t  strong. 

22.4  3  Indifferent 

6J  4  somewhat  opposed  to  it  - 

AS  $  strongly  opposed  to  it 

18.9  6  not  on  flying  status  at  present  time.  * 

-JO 

(47)  Which  one  of  the  following  statements  best  describes  your  feeBngs  relative  to  re¬ 

turning  to  combat  duty  as  a  gunner? 

.9  1  want  to  return  to  square  accounts  because  of  my  friends  who  have  been 
wounded  and  killed  overseas. 

6J  2  want  to  return  because  I  prefer  duty  as  a  combat  gunner  to  the  duty  to 
which  I  am  now  assigned. 

SS  3  want  to  return  because  I  am  dissatisfied  with  conditions  as  I  have  found 
them  here  in  the  United  States. 

2  4  want  to  return  in  order  to  obtain  increased  pay. 

12.6  S  do  not  care  whether  or  not  I  return  to  combat 
-  20.9  6  do  not  want  to  return  because  of  family  ties  and  obBgations. 

16.3  7  do  not  want  to  return  because  I  feel  I  have  contributed  my  share  fa 
combat 

36.2  8  do  not  want  to  return  because  I  feel  I  could  not  stand  up  under  t> re¬ 
strain  of  further  combat 


(48)  Which  one  of  the  statements  below  best  describes  your  present  attitude  toward 
returning  to  combat  duty  as  a  gunner?  (Write  only  one  number  in  space 


No.  48.) 


4.1  1 
12.0  2 

.8  3 
.7  4 
1.6  S 

9.2  6 


eager  to  return  immediately. 

would  return  at  any  time  I  am  needed. 

would  return  if  I  could  first  have  advanced  training  In  gunnery, 
would  return  after  I  have  been  in  this  country  about  3  months, 
would  return  after  I  have  been  in  this  country  about  6  month* 
would  want  to  return  only  if  the  war  continues  longer  than  Is  generally 


48.8  7  would  want  to  return  only  after  afl  available  trained  gunners  in  the 
United  States  have  been  sent  to  combat. 

22.0  8  would  not  want  to  return  under  any  circumstances.. 


9)  Some  men  returned  from  combat  have  indicated  that  certain  conditions  such  as 
*  Z  r.V  rocVeation  etc.  in  the  overseas  theater  were  very  unsatisfactory. 
They  also  indicated  that  if  these  conditions  were  improved  they  trajUtaffl  • 
greater  desire  to  return  to  combat.  Which  on-  of  the  following  »ndltton^  U 
improved^ would  increase  you,  desire  to  return?  Mark  only  one  win*  you 
consider  most  important.  (Write  only  one  number  m  space  No.  49.) 

48.5  1  food.  ( 

13.1  2  living  quarters.  ' 

212  3  rest  and  recreational  facilities. 

4.8  4  sanitary  conditions  (control  of  disease.) 

.7  5  medical  care. 

6.0  6  longer  time  between  missions. 
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SO)  An  JM  w«  non  desirous  of  returning  for  a  second  tour  of  combat  duty  thu 
you  were  at  the  time  you  first  arrived  bad  in  toe  United  States. 

U  j  btvt  much  more  desire  now  than  when  I  first  returned  to  the  United 

States. 

IOjo  2  have  mote  desire  now  than  when  I  first  returned  to  the  United  States, 
j  feyt  about  the  same  desire  now  as  when  I  first  returned  to  the  United 
States. 

234  4  have  less  desire  now  than  when  I  first  returned  to  the  United  State*. 

324  S  have  much  less  desire  now  than  when  I  first  returned  to  the  United 

J  d 

(51)  To  what  extent  do  you  feei  that  your  stay  in  the  United  States  since  returning 

from  combat  duty  has  affected  your  efidency  for  future  combat  duty? 

144  1  undoubtedly  increased  my  efficiency. 

23  J  2  probably  increased  my  efficiency. 

35j0  3  no  effect 

17  j  4  probably  decreased  my  efficiency. 

94  5  undoubtedly  decreased  by  efficiency. 

A  0 

(52)  In  your  opinion,  how  do  most  returned  combat  gunners  fed  about  returning  foi 

another  tour  as  rsnsbet  gunners? 

.9  1  very  will's  to  return. 

5  J  2  wflUng  tc  return. 

10.9  3  indifferent  as  to  returning. 

534  4  not  anxious  to  return. 

284  5  definitely  do  not  want  to  return. 

.  J  0  , 

(53)  How  strong  Is  your  desire  to  return  to  combat  as  a  gunner? 

SS>  1  very  strong  desire  to  return. 

94  2  some  desire  to  return.  1 

15.7  3  indifferent  as  to  returning  (not  for  or  against) 

274  4  some  desire  not  to  return. 

40.1  5  very  strong  desire  not  to  return. 

24  0 

(54)  Do  you  expect  to  volunteer  for  a  second  combat  tour  of  duty  as  a  gunner? 

4.7  1  plan  to  volunteer  for  second  tour  immediately. 

1.8  2  plan  to  volunteer  for  second  tour  after  1  more  month. 

1.5  3  plan  to  volunteer  for  second  tour  after  2  more  months.. 

14  4  plan  to  volunteer  for  second  tour  after  3  more  months. 

14  5  plan  tc  volunteer  for  second  tour  after  4  more  months. 

.7  6  plan  to  volunteer  for  a  second  tour  after  5  more  months. 

44  7  plan  to  volunteer  for  second  tour  after  6  more  months. 

81.4  8  do  not  plan  to  volunteer  for  a  second  tour. 

2.9  0 

(55)  In  your  opinion,  how  long  should  a  gunner  returned  from  combat  remain  fn  the 

United  States  before  going  back  for  a  second  tour  of  combat  duty  ?  (In  making 
your  judgment,  do  not  include  time  in  hospital.) 

1.5  1  less  than  1  month. 

1.4  2  between  1  and  2  months, 

2.2  3  between  2  and  4  months. 

1.5  4  between  3  am'  4  months. 


4 
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65  S  between  5  and  6  month*. 

10.9  6  between  6  and  7  month*. 

4.4  7  between  7  and  8  months. 

7.5  8  between  9  and  10  months. 

60.2  9  more  than  10  months. 

34  0 

If  you  were  to  be  returned  to  combat  as  a  gunner,  do  you  fed  that  you  would  neeu 

more  training  in  specific  phases  of  gunnery  before  being  sent  overseas?  (If  you  do  not 

fed  in  reed  of  additional  training,  write  “1”  in  all  three  spaces,  56,  57  and  58.) 

41.6  1  do  not  fed  in  need  of  additional  training. 

274  2  would  like  more  training  in  air-to-air  firing. 

8.1  3  would  like  more  training  in  turret  operation. 

24  4  would  like  more  training  in  range  estimation. 

6.7  5  would  like  more  training  in  sights  and  sighting. 

.4  6  would  like  more  training  in  intercommunication  training  (intercom.). 
84  7  would  like  more  training  in  other  air  crew  duties,  crewmanship,  etc. 

24  8  would  like  more  training  in  Jam  Handy,  Waller,  Trainer,  etc. 

24  0  ~ 

(56)  Record  in  space  No.  56  the  number  of  your  first  choke  (the  iype  of  training  you 
need  most). 


(57)  Record  in  space  No.  57  the  number  of  your  second  choice  or  requirement. 

(58)  Record  in  space  No.  58  the  number  of  your  third  choice  or  requirement. 

Some  gunners  received  training  in  a  specialty  other  than  gunnery  such  as  armament, 
radio  operation,  etc.  Indicate  in  the  next  two  questions  whether  you  fed  that  your 
present  ability  in  the  specialty  other  than  gunnery  which  you  may  have  is  suffident  fot 
meeting  the  needs  of  combat  operations,  or  whether  you  think  a  refresher  course  would 
be  required.  , 

(59)  In  which  one  of  the  specialties  listed  below  do  you  think  you  need  a  refresher 

course  before  going  back  to  combat?  (Write  only  one  number  in  space  No.  59.) 
14.8  1  received  no  special  training  other  than  gunnery. 

36.7  2  do  not  need  a  refresher  course  in  my  specialty. 

9.6  3  .need  a  refresher  course  in  radio  operation.  i 

10.4  4  need  a  refresher  course  in  mechanic*. 

16.8  5  need  a  refresher  course  in  armament 

6.5  6  need  a  refresher  course  in  airplane  mechanics. 

1.0  7  need  a  refresher  course  in  photography. 

1.5  8  other  (if  trot  listed  above,  write  in  specialty  on  back  of  answer  sheet 

after  No.  59). 


24  0 

(60)  In  which  one  of  the  specialties  listed  below  do  you  consider  yourself  qualified  for 

meeting  the  needs  of  combat? 

15.7  1  received  no  special  training  other  than  gunnery. 

19.8  2  need  a  refresher  course  in  my  specialty. 

14.0  3  feci  qualified  for  combat  in  radio  operation. 

11.0  4  feel  qualified  for  combat  in  mechanics. 

27  4  5  feel  qualified  for  combat  b  armament 

7,1  6  feel  qualified  for  combat  b  airplane  mechanics. 

4  7  feel  qualified  for  combat  b  photography.^  .  .  . 

!.3  8  oilier  (if  not  listed  above  write  b  specialty  -n  back  of  answer  sheet 

after  No.  60). 
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(oi)  Since  returning  from  combat,  do  you  become  easily  exhausted  or  «S  tired  oat? 

4if  l  often. 

434  1  sometimes. 

74  3  never. 

J  0 

(62)  Since  returning  from  oversea*  duty,  have  you  felt  sick  to  your  stomach  or  felt  that 

you  had  to  vomit?- 

12.4  1  often. 

454  2  sometimes.  ■ 

414  J  never. 

(63)  Do  you  now  find  It  difficult  to  concentrate  on  tasks  that  didn’t  bother  you  before 

you  went  to  combat? 

254  I  often.  ■  •’ 

504  2  sometimes. 

23.7  3  never.  ' 

(64)  Do  you  have  shaking  or  trembling  hands  or  knees  or  muscular  twitches? 

244  1  often. 

514  2  sometimes. 

24.1  3  ucver. 

.10 

(65)  Are  you  now  more  easily  made  grouchy  or  more  easDy  irritated  than  you  were 

before  you  went  to  combat? 

53.9  1  mofe. 

314  2  just  as  often. 

9.1  3  less.  ;  . 

.10 

(66)  Do  thoughts  of  your  combat  experience  produce  feelings  of  fear? 

143  1  often. 

53.0  2  sometimes.  , 

32.6  3  never. 

.10 

(67)  Since  returning  from  overseas  duty  are  you  easily  confused  or  "rattled”? 

16.2  1  often.  * 

55.<j  2  sometimes. 

28.1  3  never. 

.1  C 

(68)  Do  you  worry  about  things  or  conditions  that  you  probably  can’t  change  anyway? 

23.4  1  often. 

53.3  2  sometimes. 

22.7  3  never. 

\  ' 

(69)  Do  you  have  fears  which  you  cannot  seem  to  drive  out  of  your  mind? 

13.7  1  often. 

41.9  2  sometimes. 

44.2  3  never. 

.1  0 

.Distribution  of  Health  Scores 
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Percent 


Sum  of  answer  to  questions  61  to  76  indurfvo 
Scon 

. .  and  below . . 

. M,  24,  25  . Wj6 

. 2 *’  27>  « .  H.9 

. 29,30,31 . l$j 

. 32>  33»  34 . 154 

. 3S'36»  37  . . 114 

. 3S»  39»  40 . . 

a . 41,42,43 .  24 

9 . 44  and  above 


(70)  Are  you  now  bothered  with  sleepless  nights?  * 

194  1  often. 

524  2  sometimes. 

284  3  never. 

(71)  Are  you  now  restless  or  not  able  to  sit  still?  -  ■ 

42.4  1  often. 

45.9  2  sometimes. 

114  3  never. 

-  ‘  «  .  '  • 

1  *  / 

(72)  Do  loud  or  sudden  sounds  »n»kf  you  Jumpy? 

404  1  often. 

46.1  2  sometimes.  - 

134  3  never. 

(73)  Do  you  feel  “blue”  or  depressed? 

214  1  often.  ■  • 1 

63.6  2  sometimes.  •  *  ' 

154  3  never.  < 

(74)  Do  you  become  hesitant  and  so  uncertain  of  yourself  that  you  are  unable  to  make 

a  decision  as  quickly  as  you  think  you  should? 

154  1  often.  •. 

53.9  2  sometimes. 

304  3  never. 

’  l . 

(75)  Do  you  relive  the  “close  calls”  which  you  experienced  in  combat?  (Not  tallied— 

column  75  used  to  cede  hejjth  score.) 

1  often. 

2  sometimes. 

3  never. 

4  did  not  have  “close  caHs.” 

(76)  Since  returning  from  combat  do  you  have  sightmarei? 

10.0  1  often. 

454  2  sometimes. 

43.9  3  never. 

.7  0 
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(77)  la  yowr  opinion,  bow  long  doe*  it  require  to  rest  up  after  completing  a  tour  of 
duty  u  a  gunner  In  a  combat  crew?  la  making  your  judgment  do  not  consider 
caret  requiring  an  extended  stay  in  a  hospital.  (Write  only  one  number  la 
apace  No,  77). 


LO 

1 

lew  than  2  weeks. 

14 

2 

2  or  i  Weeks. 

4 A 

S 

1  month. 

5  4 

4 

2  months. 

64 

5 

3  months. 

SA 

8 

4  months 

1j6 

7 

5  months 

18.9 

8 

6  months 

544 

9 

more  than  6  months 

34 

0 

(78)  If  you  were  given  a  choice  today  between  assignment  to  a  second  tour  of  duty  at 

a  gunner  or  assignment  as  a  basic  soldier,  which  assignment  would  you  prefer? 

89.9  1  assignment  to  a  second  tour  as  a  gunner. 

55.4  2  assignment  as  a  bade  soldier.  - 

4j6  0 

(79)  After  you  returned'  from  overseas  duty,  were  you  processed  fn  a  Redistribution 

Center  between  24  May  1944  and  6  Aug.  1944?  The  three  Redistribution  Cen¬ 
ters  are  at  Atlantic  City,  N.  J.,  Miami  Beach,  Fla.,  and  Santa  Monica,  Calif. 

25.4  1  not  processed  in  Redistribution  Center. 

11.4  2  processed  at  Atlantic  City  between  24  May  1944  and  6  August  1944. 

18.1  8  processed  at  Miami  Beach  between  24  May  1944  and  6  August  1944. 

6.1  4  processed  at  Santa  Monica  between  24  May  1944  and  6  August  1944. 

42.6  5  processed  at  Atlantic  City,  Miami  Beach  or  Santa  Monica  but  not  during 

period  24  May  1944  to  6  August  1944. 

1.4  0 

(80)  Following  is  a  list  of  courses  offered  at  most  gunnery  schools.  Write  down  the 

number  of  each  of  the  courses  in  which  you  have  not  received  instruction.  Be 
jure  you  indicate  every  course  which  you  have  not  taken.  (Write  the  numbers 
on  the  back  of  the  answer  sheet  after  No.  80). 

28.7  1 
52A  2 

19.6  8 
2  U  4 
3G.7  5 
.16.0  6 

8.1  7 

14.6  8 

18.9  9 
2J  10 
3.8  0 

(81)  If  It  became  necessary  lor  you  to  make  one  of  the  following  chaises  which  one 

would  you  select? 

1.  I  no  iougcr  want  to  remain  on  dying  status  hut  prefer  reassignment  to  ground 
duty  in  the  Air  Forces  in  this  country. 

1.  I  wish  to  remain  on  flying  status  and  am  willing  to  return  to  combat  for  a 
second  tour  after  I  have  received  further  training  even  thongh  during  part  ' 
of  this  training  I  do  not  receive  flight  pay. 

8.  I  wish  to  remain  on  flying  status  and  want  immediate  assignment  to  a  second 
four  of  combat  duty. 


position  firing, 
gun  camera  missions, 
preventive  matrtenance.  ‘ 
basic  deflection  range, 
shotgun  turrets. 

Jam  Bandy  training, 
turret  operation. 

training  on  the  job  and  not  in  gunnery  school, 
received  instructions  in  all  courses  listed, 
never  had  gunnery  training. 
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(M)  State  briefly  what  promises  were  made  to  you  when  you  f»«t  through  the  1 to* 
distribution  Center,  concerning  assignment,  type  of  work,  possible  location, 
etc.  Tell  to  wbat  extent  these  promises  were  met  or  fulfilled. 

(M)  Would  you  be  more  willing  to  return  to  combat  If  you  were  assigned  to  a  B-W? 

1.  Yea. 

2.  No. 

(84)  If,  at  some  future  time,  ft  were  possible  for  the  Air  Corps  to  set  up  a  training 

program  which  would  not  necessarily  be  limited  to  army  specialties  would  you 
be  interested  in  going  to  school  for  three  (3)  to  six  (6)  months? 

1.  Yes. 

2.  No. 

If  your  answer  is  yes,  list  in  order  of  preference  on  back  of  answer  sheet  the  three 
courses  which  you  would  like  to  take.  Remember  that  these  ^references  need  not 
necessarily  be  related  or  limited  to  am-'  specialties. 

(85)  At  present,  bow  much  are  you  bothered  by  air  sickness? 

1. .  never. 

2.  only  on  a  few  flights. 

3.  frequently. 

4.  on  nearly  every  flight. 

5.  on  every  flight 

6.  not  on  flying  status. 


f 
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